-- Logs begin at Thu 2022-06-16 11:06:30 UTC, end at Thu 2022-06-16 12:12:07 UTC. -- Jun 16 11:36:18.139726 dv-cinder-846146-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 11:36:18.147657 dv-cinder-846146-2-smb devstack@keystone.service[91890]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 11:36:18 2022] *** Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: nodename: dv-cinder-846146-2-smb Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: machine: x86_64 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: clock source: unix Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: pcre jit disabled Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: detected number of CPU cores: 4 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: current working directory: / Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: detected binary path: /usr/bin/uwsgi-core Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: your processes number limit is 47680 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: your memory page size is 4096 bytes Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: detected max file descriptor number: 2048 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: lock engine: pthread robust mutexes Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: thunder lock: enabled Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 11:36:18.155859 dv-cinder-846146-2-smb devstack@keystone.service[91890]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 11:36:18.195231 dv-cinder-846146-2-smb devstack@keystone.service[91890]: Python main interpreter initialized at 0x5566dfe4d9c0 Jun 16 11:36:18.195231 dv-cinder-846146-2-smb devstack@keystone.service[91890]: python threads support enabled Jun 16 11:36:18.195231 dv-cinder-846146-2-smb devstack@keystone.service[91890]: your server socket listen backlog is limited to 100 connections Jun 16 11:36:18.195231 dv-cinder-846146-2-smb devstack@keystone.service[91890]: your mercy for graceful operations on workers is 90 seconds Jun 16 11:36:18.195601 dv-cinder-846146-2-smb devstack@keystone.service[91890]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 11:36:18.195687 dv-cinder-846146-2-smb devstack@keystone.service[91890]: *** Operational MODE: preforking *** Jun 16 11:36:18.195949 dv-cinder-846146-2-smb devstack@keystone.service[91890]: *** uWSGI is running in multiple interpreter mode *** Jun 16 11:36:18.195949 dv-cinder-846146-2-smb devstack@keystone.service[91890]: spawned uWSGI master process (pid: 91890) Jun 16 11:36:18.196155 dv-cinder-846146-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 11:36:18.197242 dv-cinder-846146-2-smb devstack@keystone.service[91890]: spawned uWSGI worker 1 (pid: 91905, cores: 1) Jun 16 11:36:18.197242 dv-cinder-846146-2-smb devstack@keystone.service[91890]: spawned uWSGI worker 2 (pid: 91906, cores: 1) Jun 16 11:36:18.197242 dv-cinder-846146-2-smb devstack@keystone.service[91890]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 11:36:23.719125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:36:23.719125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: from cryptography.utils import int_from_bytes Jun 16 11:36:23.719907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:36:23.719907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: from cryptography.utils import int_from_bytes Jun 16 11:36:23.720321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:36:23.720321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: from cryptography.utils import int_from_bytes Jun 16 11:36:23.720429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 11:36:23.720429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: from cryptography.utils import int_from_bytes Jun 16 11:36:23.770135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 11:36:23.770296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 11:36:23.770385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 11:36:23.770471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 11:36:23.770542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] command line args: [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 11:36:23.770652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] command line args: [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 11:36:23.770789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 11:36:23.770877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 11:36:23.770954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ================================================================================ {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 11:36:23.771051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ================================================================================ {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 11:36:23.771205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] admin_token = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] admin_token = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] config_dir = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] config_dir = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] config_source = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.771902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] config_source = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] debug = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] debug = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.772982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_config_append = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_config_append = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.773934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_dir = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_dir = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_file = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_file = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.774941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775451 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.775927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.776999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.777081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.777240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.777361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.777511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.777640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.777992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] publish_errors = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] publish_errors = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.778964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] standard_threads = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779553 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] standard_threads = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.779931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] use_journal = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] use_journal = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] use_json = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] use_json = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] use_stderr = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] use_stderr = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] use_syslog = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.780931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] use_syslog = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.781126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.781206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 11:36:23.781277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.781404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.781493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.781641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.781726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.781902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.782974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.783975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.784876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.785997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.786833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.787930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.788952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.789900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.790995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.791973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.792894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.793942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.794981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.795108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.795218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.795351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.795460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.795587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.795689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.796341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.796452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.796580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.796685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.796831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.796912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.797997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.798961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.799991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.800917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.801870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.802994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.803994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.804904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.805791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.891839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.892149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.892409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.892503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.external = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.892665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.892755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.892960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.external = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.password = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] auth.token = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.893969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.password = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] auth.token = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.894846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.895995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.896983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.897958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.898935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.899867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.900840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.901990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.902993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.903957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.904977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905586 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.905948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.906971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.907920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.908935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.909900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.910884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911603 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.911980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.912929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.913889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.914882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.915955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.916910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.917952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.918943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.919894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.920021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.920139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.920245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.920367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.920484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.920601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.921945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.922999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.923947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.924911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.925971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.926948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] role.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] role.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] role.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] role.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.927894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.928967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.929923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.930921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.931882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932597 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.932949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.933894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934769 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.934889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.935832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.936198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.936318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.937928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.938896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.939961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.940918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.connection = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.connection = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.941901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.942943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.943996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.944952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.945070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.945187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.945304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.945429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.945547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 11:36:23.945665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 11:36:23.945783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 11:36:23.974594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.974781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.974936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.975022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.975171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.975397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.984131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:23.984549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.011698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.011928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.012013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.012189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.066411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.067869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.116293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.116525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.118456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.118721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.182778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.183021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.183140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.183267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.183446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.183665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.183880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.184279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.186252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.187025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.187254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.187596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.208135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.208367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.208587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.208805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.209019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.209231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.209443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.211792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.212029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.212258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.212482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.212704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.212923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.213141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.220589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.222612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.233529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.233706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.233932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.234153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.234367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.234577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.234810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91906) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.240157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.240532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.240942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.241338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.241739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.242134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.242367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91905) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 11:36:24.252342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.252554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 11:36:24.252893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.253092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 11:36:24.253540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.253802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.254060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.254316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.262491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.262730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 11:36:24.263074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.263278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 11:36:24.263729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.263993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.264252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.264558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.265721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.265996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.266260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.266536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.274661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.276204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.276483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.276753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.277032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.278028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.278308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.278615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.278886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.279162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.279418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.279683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.279950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.280741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.281013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.281276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.289010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.292358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.292639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.292920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.293359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.293647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.293911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.294181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.294456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.294756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.295035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.295302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.308382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.310018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.310297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.315919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.316211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.316488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.323923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.324202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.326079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.329237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.329521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.329798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.330075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.330345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.330633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.330906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.331076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.331160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.331577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.337134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.337422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.337702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.345717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.345993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.350266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.350540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.353611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.353900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.354184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.354469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.354779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.355053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.355146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.355324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.355593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.358711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.359004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.364080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.367769 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.371421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.371724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.372003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.372283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.372555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.372830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.377480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.377759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.382438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.386072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.386365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.393907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.394194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.394456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.394750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.395428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.399053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.402685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.402922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.403220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.403508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.403789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.404064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.404353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.404438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.404660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.408437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.408724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.409126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.409417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.409694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.427296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.427582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.427864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.428143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.428421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.428710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.428985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.442445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.442980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.443459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.443940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.449100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.452963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.453074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.454702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.454980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.456321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.459039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.460854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.461132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.461255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.461581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.461868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.462113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.462204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.462423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.469964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.471601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.474845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.475134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.475417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.475701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.478465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.478772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.479054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.481187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.481485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.481774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.482987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.486828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.487081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.487359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.495259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91906) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.495536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.495812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.496085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.496355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.496640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.496908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.497181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.497453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.497820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.498090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.498364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.498655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.498943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91906) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.506533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.510899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.515822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.517456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.519259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.519539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.519820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.530756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.532648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.537730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.538022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.538300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.538571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.540944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566dfe4d9c0 pid: 91906 (default app) Jun 16 11:36:24.544440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5bb15-d152-4cb7-9106-a4446332c8c1 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:24.544737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5bb15-d152-4cb7-9106-a4446332c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:24.545017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5bb15-d152-4cb7-9106-a4446332c8c1 None None] PATH_INFO: `/v3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:24.549685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.552179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Jun 16 11:36:24 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:24.552336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.552336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.559465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91905) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 11:36:24.559748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.560025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.560297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.560567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.560851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.561411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.561686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.562065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.562336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.562623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.562901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.563165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.563421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91905) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 11:36:24.613013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566dfe4d9c0 pid: 91905 (default app) Jun 16 11:36:33.249462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:33.249979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:33.249979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:33.251299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:33.258557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:33.259000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:33.259160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:33.328973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: INFO dbcounter [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] Registered counter for database keystone Jun 16 11:36:33.350179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG oslo_db.sqlalchemy.engines [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:36:33.356294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writer thread running {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:36:33.529461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG passlib.handlers.bcrypt [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91905) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 11:36:33.529885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG passlib.handlers.bcrypt [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91905) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 11:36:33.585594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:33.587255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:33.711111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1/3] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 11:36:33.881391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:33.951686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: INFO dbcounter [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] Registered counter for database keystone Jun 16 11:36:33.970964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG oslo_db.sqlalchemy.engines [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 11:36:33.977019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writer thread running {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 11:36:34.093913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd38e8-f338-4aef-b119-24c869f959b4 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:34.098138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:34.098814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:34.099101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:34.099375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:34.107310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:34.158950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING keystone.common.rbac_enforcer.enforcer [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 11:36:34.159236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b2e55-fbd8-4a60-b192-e860f0afb526 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:34.168473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Jun 16 11:36:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:36:34.175058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:34.190373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28beb6-008c-4f06-baab-b831338b4579 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:34.194871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:34.195974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:34.196263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:34.196548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] PATH_INFO: `/v3/projects/76796d2f47b24128882c958275f16408` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:34.198053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] RBAC: Authorizing `identity:get_project(project_id=76796d2f47b24128882c958275f16408)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:34.248706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 11:36:34.249622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf88fd4-b83a-4c8f-8057-d258216b3c7b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:34.254269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 2/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Jun 16 11:36:34 2022] GET /identity/v3/projects/76796d2f47b24128882c958275f16408 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:36.339140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5d2a-bf7f-4d35-b98b-8e58a011a11b None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:36.339663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5d2a-bf7f-4d35-b98b-8e58a011a11b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:36.339663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5d2a-bf7f-4d35-b98b-8e58a011a11b None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:36.344370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 4/6] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:36.349574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:36.350032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:36.350127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:36.368333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:36.369845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:36.377600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 11:36:36.399639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5d2a-bf7f-4d35-b98b-8e58a011a11b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:36.411904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5d2a-bf7f-4d35-b98b-8e58a011a11b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:36.416047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624bb92-ac05-4e0d-99f7-42c0fdfc25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:36.416665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624bb92-ac05-4e0d-99f7-42c0fdfc25c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:36.416948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624bb92-ac05-4e0d-99f7-42c0fdfc25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:36.417220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624bb92-ac05-4e0d-99f7-42c0fdfc25c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:36.425241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624bb92-ac05-4e0d-99f7-42c0fdfc25c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:36.427021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624bb92-ac05-4e0d-99f7-42c0fdfc25c9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:36.435483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Jun 16 11:36:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:36:36.441316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:36.450076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03307-745f-4604-82ff-8b40dad79709 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:36.454491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ebc42-c306-4ad0-a6db-035a8d95a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:36.455375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ebc42-c306-4ad0-a6db-035a8d95a41a admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:36.455661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ebc42-c306-4ad0-a6db-035a8d95a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:36.455941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ebc42-c306-4ad0-a6db-035a8d95a41a admin admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:36.457331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ebc42-c306-4ad0-a6db-035a8d95a41a admin admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:36.459197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ebc42-c306-4ad0-a6db-035a8d95a41a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:36.460741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 4/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Jun 16 11:36:36 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:38.639373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed820bf-b944-451b-8569-0ff7280a98cc None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:38.639904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed820bf-b944-451b-8569-0ff7280a98cc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:38.639904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed820bf-b944-451b-8569-0ff7280a98cc None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:38.641252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:36:38.646380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:38.646620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27640dd5-23d2-4ce5-a29a-543e415f7321 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:38.647015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:38.647100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27640dd5-23d2-4ce5-a29a-543e415f7321 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:38.647184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:38.647261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27640dd5-23d2-4ce5-a29a-543e415f7321 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:38.648546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 5/11] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:38.653358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:38.653646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:38.653925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:38.671978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:38.673170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:38.688076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG passlib.handlers.bcrypt [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91906) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 11:36:38.688499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG passlib.handlers.bcrypt [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91906) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 11:36:38.733607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:38.735205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:38.751810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:38.774537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:38.798066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:38.832154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:38.853778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:38.877415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f392-b354-44dd-8929-25dca973f2cc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:38.910660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:38.911404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:38.911689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:38.911968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:38.923857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:38.935062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:38.935927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:36:38.937932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:36:38.942768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:38.957306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c17f-6b11-4324-ad23-dd6f3954c041 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:38.959610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:38.993900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:38.994894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:38.995182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:38.995457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.023244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:39.040744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436ce3a-2bb0-41ad-a21f-270241c1f26e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:39.061925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.063470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.075418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:39.076088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:39.076371 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:39.076648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.077962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:39.078270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.079688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.091122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:39.096763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:39.160067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:36:39.165782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:39.168383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:39.199232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4719-0a2e-4a09-a5af-7a870dea0d9b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:39.233484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:39.234343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:39.234644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:39.234922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.236130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.237594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.239210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:39 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:39.244538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:39.258965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:39.260248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d434006-5606-4df1-acf0-7ebdf914a61e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:39.296515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:39.297715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:39.298006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:39.298283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.317030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.318477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:36:39.338613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:39.339449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:39.340263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:36:39.340263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:36:39.340263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:36:39.340263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:39.340263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:36:39.341895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c748cbb-6a2b-416f-aad4-46af1f163ef4 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:39.345694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:39.376879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:39.377671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:39.377959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:39.378233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.379441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.380883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.382464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:39.388077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:39.402972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:39.446816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037f895-1938-4333-a6ba-8a4e7df0384f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:39.468289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:39.479778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:39.480501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:39.480780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:39.481057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.481780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:39.482087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.484068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c9801-e075-460a-98f7-5b0a3f03b306 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.487261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ea0e1-4248-4ca8-bd77-4321331b520b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:39.501802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:39.521351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:39.522028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:39.522309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:39.522606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:39.523459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.domain.id=default, user.id=7a61f538ea9c41cc98218141be79ba7b) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:39.523772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:39.525255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b4a3-df62-43a4-a1a9-7922aa043bb6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:39.532979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Jun 16 11:36:39 2022] GET /identity/v3/role_assignments?user.id=7a61f538ea9c41cc98218141be79ba7b&scope.domain.id=default&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:41.984360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2304-305e-4d64-af1a-fd4e7faa0bae None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:41.985337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2304-305e-4d64-af1a-fd4e7faa0bae None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:41.985825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2304-305e-4d64-af1a-fd4e7faa0bae None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:41.987448 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:41.992759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac988-1cd3-4792-a1af-8a8e2fc6c7eb None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:41.993153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac988-1cd3-4792-a1af-8a8e2fc6c7eb None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:41.993320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac988-1cd3-4792-a1af-8a8e2fc6c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.019614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-65dac988-1cd3-4792-a1af-8a8e2fc6c7eb None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:42.021101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-65dac988-1cd3-4792-a1af-8a8e2fc6c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:42.105638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:42.140860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2304-305e-4d64-af1a-fd4e7faa0bae None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:42.258831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e3a4-56ec-4703-9eb9-e3a7f11a5dfa None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.259467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e3a4-56ec-4703-9eb9-e3a7f11a5dfa None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.259979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e3a4-56ec-4703-9eb9-e3a7f11a5dfa None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.261556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:42.279957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59506-663f-4f8d-9a9d-2a6bf4967918 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.280577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59506-663f-4f8d-9a9d-2a6bf4967918 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.281076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59506-663f-4f8d-9a9d-2a6bf4967918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.291218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2304-305e-4d64-af1a-fd4e7faa0bae None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:42.323603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-26c59506-663f-4f8d-9a9d-2a6bf4967918 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:42.325128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-26c59506-663f-4f8d-9a9d-2a6bf4967918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:42.326075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:42.343278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:42.344179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.344365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.344643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.360050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:42.377767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:42.378709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:42.379946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 12/25] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:42.385652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:42.491448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:42.492834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aaec6-8c11-4984-ba18-b95de290f80b None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.493135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aaec6-8c11-4984-ba18-b95de290f80b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.493509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aaec6-8c11-4984-ba18-b95de290f80b None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.495051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 15/27] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:42.500688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.500981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.501262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.513261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:42.516406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2800e8-7945-4c78-af8f-61688fa31a0e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:42.530819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:42.532027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:42.556546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:42.557605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.558882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.559543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.562892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:42.567482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:42.569376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:42.590809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 13/28] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:42.595183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:42.661817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:42.663860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:42.680117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:42.791598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96ffb-4b63-4ae0-86c4-ffa35948867c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:42.824992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd91a-38ef-4a7f-8cf2-10bf33065ec0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:42.828362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3838def-e475-44b1-8e14-3cdbac242934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:42.829187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3838def-e475-44b1-8e14-3cdbac242934 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.829638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3838def-e475-44b1-8e14-3cdbac242934 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.830049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3838def-e475-44b1-8e14-3cdbac242934 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.830958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3838def-e475-44b1-8e14-3cdbac242934 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:42.832462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3838def-e475-44b1-8e14-3cdbac242934 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:42.868434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:42.869318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:42.869603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:42.869882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:42.871122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:42.872670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:42.875309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 17/30] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:42 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:42.875864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:42.878574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:42.993286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b2fb-5efb-4c79-ac57-0bea6446c858 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:43.032696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:43.033968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.034485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.034983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.047058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:43.048854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:43.054605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 14/31] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jun 16 11:36:42 2022] POST /identity/v3/roles => generated 219 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:43.054605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a670-ade0-46bb-83bd-54203f77671b None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.054605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a670-ade0-46bb-83bd-54203f77671b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.054605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a670-ade0-46bb-83bd-54203f77671b None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.054605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 15/32] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:43.055324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3a670-ade0-46bb-83bd-54203f77671b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7a17bb6b-e8bc-425d-a4af-3c8e486e7a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:36:43.104722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:43.105602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:43.106408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:36:43.106408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:36:43.106408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:36:43.106408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:36:43.106408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 18/33] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:43.107831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.108118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.108951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.153993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:43.155272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:43.191655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:43.198312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3a670-ade0-46bb-83bd-54203f77671b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:43.240400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:43.241567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.242201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.242746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.244704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:43.246622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:43.249479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 16/34] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:43.254759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:43.268670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:43.303141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:43.303706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:43.388893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618874d8-4f15-4e5b-8931-01db927b70bd None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:43.426925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beee21-24ee-49c1-84cb-3de96c76b987 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:43.430202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:43.430939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.431234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.431521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.432263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:43.432578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:43.433970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:43.448885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 17/36] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:43.449685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:43.468481 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918552c-9978-4f3f-91cf-15709333f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:43.469364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918552c-9978-4f3f-91cf-15709333f33b None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.469646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918552c-9978-4f3f-91cf-15709333f33b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.469921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918552c-9978-4f3f-91cf-15709333f33b None admin] PATH_INFO: `/v3/domains/default/users/7a61f538ea9c41cc98218141be79ba7b/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.471998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918552c-9978-4f3f-91cf-15709333f33b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7a61f538ea9c41cc98218141be79ba7b, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:43.473504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918552c-9978-4f3f-91cf-15709333f33b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:43.480398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:43.671417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3b9f4-fdf0-4e21-9f6d-8d198d884f89 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:43.709577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb934c3-4d1e-4447-8097-1f72c9db7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:43.710271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb934c3-4d1e-4447-8097-1f72c9db7245 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.710567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb934c3-4d1e-4447-8097-1f72c9db7245 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.710907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb934c3-4d1e-4447-8097-1f72c9db7245 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.711682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb934c3-4d1e-4447-8097-1f72c9db7245 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:43.713111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb934c3-4d1e-4447-8097-1f72c9db7245 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:43.782514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jun 16 11:36:43 2022] POST /identity/v3/roles => generated 225 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:43.783701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e6841-1d68-4510-b41b-a7704b703271 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.784007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e6841-1d68-4510-b41b-a7704b703271 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.784295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e6841-1d68-4510-b41b-a7704b703271 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.789991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 19/38] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:43.789991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e6841-1d68-4510-b41b-a7704b703271 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:43.796977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 20/39] 10.222.0.36 () {58 vars in 1361 bytes} [Thu Jun 16 11:36:43 2022] PUT /identity/v3/domains/default/users/7a61f538ea9c41cc98218141be79ba7b/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:36:43.798904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1162e0-6cc7-4187-bbb3-456cf7a035e2 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.799200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1162e0-6cc7-4187-bbb3-456cf7a035e2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.799484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1162e0-6cc7-4187-bbb3-456cf7a035e2 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.804324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 21/40] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:43.805370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ea05c-5827-4f26-a7d7-1cf752b7777f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.805638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ea05c-5827-4f26-a7d7-1cf752b7777f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.805919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ea05c-5827-4f26-a7d7-1cf752b7777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.828383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e09ea05c-5827-4f26-a7d7-1cf752b7777f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:43.830075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e09ea05c-5827-4f26-a7d7-1cf752b7777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:43.884284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:43.923926 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:43.925336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:43.925701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:43.926050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:43.951450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:43.955950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:43.957462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:43.976664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e6841-1d68-4510-b41b-a7704b703271 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:44.035667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:44.036776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:44.037288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:44.037873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:44.038953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:44.040641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:44.054607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:44.055269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:44.140150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 20/43] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:36:43 2022] POST /identity/v3/projects => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:44.147362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:44.159487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b4f79-ef1f-4e07-b271-e4df54193623 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:44.160819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:44.211450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:44.212827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:44.213248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:44.213537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:44.214325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:44.217458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:44.293369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54c6b2-9eeb-41fe-9ce6-b5efa0290fe4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:44.299368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 24/44] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jun 16 11:36:44 2022] POST /identity/v3/roles => generated 223 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:44.347483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083186-8816-4b81-a392-69bafd6280b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:44.348307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083186-8816-4b81-a392-69bafd6280b0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:44.348600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083186-8816-4b81-a392-69bafd6280b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:44.348939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083186-8816-4b81-a392-69bafd6280b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:44.350169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8083186-8816-4b81-a392-69bafd6280b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:44.351693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8083186-8816-4b81-a392-69bafd6280b0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:44.353381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 21/45] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:44.359306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:44.477411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc54a41-c1a8-4459-92e1-eb98bfb15b56 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:44.513198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994373-5510-4b8d-a28d-ea4caaa214de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:44.514160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994373-5510-4b8d-a28d-ea4caaa214de None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:44.514495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994373-5510-4b8d-a28d-ea4caaa214de None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:44.515339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994373-5510-4b8d-a28d-ea4caaa214de None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:44.516049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50994373-5510-4b8d-a28d-ea4caaa214de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:44.517530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50994373-5510-4b8d-a28d-ea4caaa214de None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:44.648612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 25/46] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:36:44 2022] POST /identity/v3/projects => generated 312 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:45.965354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195e61-1bae-4d56-b92c-5aa222deba37 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:45.965854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195e61-1bae-4d56-b92c-5aa222deba37 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:45.965935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195e61-1bae-4d56-b92c-5aa222deba37 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:45.967301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 22/47] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:45.972966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:45.973386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:45.973539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:45.990388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:45.991604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:46.002391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:46.055754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:46.079825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c195e61-1bae-4d56-b92c-5aa222deba37 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:46.097538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:46.189575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c195e61-1bae-4d56-b92c-5aa222deba37 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:46.221410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:46.222191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.222472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.222771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.232559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:46.240683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:46.241505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:46.242256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 23/49] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:46.248576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:46.344587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358a89-1297-4ae1-8cd5-54e56a85a903 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:46.378193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:46.378896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.379184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.379462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.380220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:46.380531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:46.381920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:46.390055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 27/50] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:46.395528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:46.463011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:46.497480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051178d-dd31-48cd-8d53-6bb26f5afeda None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:46.529703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:46.531131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.531418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.531696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.533107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:46.534556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:46.536224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 24/51] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:46 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:46.541694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:46.554092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:46.641334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76773-3596-44e6-8276-f83aba110217 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:46.675070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4981faf-5628-40ac-ac3a-fbea409a9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:46.675901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4981faf-5628-40ac-ac3a-fbea409a9f9c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.676187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4981faf-5628-40ac-ac3a-fbea409a9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.676465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4981faf-5628-40ac-ac3a-fbea409a9f9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.677752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4981faf-5628-40ac-ac3a-fbea409a9f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:46.679297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4981faf-5628-40ac-ac3a-fbea409a9f9c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:46.681026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 28/52] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:46.687593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:46.738093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d2f5-d0ec-42ec-b77d-1d71100e3a7f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.738315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d2f5-d0ec-42ec-b77d-1d71100e3a7f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.738638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d2f5-d0ec-42ec-b77d-1d71100e3a7f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.740031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 29/53] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:36:46.744784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.745077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.745362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.761419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:46.762651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:46.788640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cef87-bd10-4c4b-8f23-983fbff131fa None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:46.822220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:46.822906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.823195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.823498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.824311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.domain.id=default, user.id=7a61f538ea9c41cc98218141be79ba7b) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:46.824628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:46.826065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:46.827427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 30/54] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:46.828900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:46.836404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 25/55] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Jun 16 11:36:46 2022] GET /identity/v3/role_assignments?user.id=7a61f538ea9c41cc98218141be79ba7b&scope.domain.id=default&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:46.851197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:46.860063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:46.959590 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7306db1-1280-45ff-83bf-63081e8ecfec None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:46.994562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d135d-9898-40e7-970b-1bdec81382b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:46.995329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d135d-9898-40e7-970b-1bdec81382b5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:46.995616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d135d-9898-40e7-970b-1bdec81382b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:46.995899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d135d-9898-40e7-970b-1bdec81382b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:46.997107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d135d-9898-40e7-970b-1bdec81382b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:46.998562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d135d-9898-40e7-970b-1bdec81382b5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:47.000252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 31/56] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:47.006069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:47.105419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a295a4-d6c9-44f7-8f72-065b65b884c3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:47.137133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c44d-88a3-4774-9a2a-ceb65f2a1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:47.137786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c44d-88a3-4774-9a2a-ceb65f2a1dab None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:47.138076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c44d-88a3-4774-9a2a-ceb65f2a1dab None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:47.138360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c44d-88a3-4774-9a2a-ceb65f2a1dab None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:47.139096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c44d-88a3-4774-9a2a-ceb65f2a1dab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:47.141072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c44d-88a3-4774-9a2a-ceb65f2a1dab None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:47.218285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 26/57] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Jun 16 11:36:47 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:49.308489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45678ba7-a786-4842-a0fe-86581ef59adc None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:49.309001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45678ba7-a786-4842-a0fe-86581ef59adc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:49.309083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45678ba7-a786-4842-a0fe-86581ef59adc None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:49.310442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 32/58] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:49.315784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:49.316166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:49.316353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:49.333318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:49.334859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:49.379775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:49.399387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 27/59] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:49.423811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45678ba7-a786-4842-a0fe-86581ef59adc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:49.496918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:49.521307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45678ba7-a786-4842-a0fe-86581ef59adc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:49.553925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b11d0a-ba0b-48cd-bb90-77784b92af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:49.554723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b11d0a-ba0b-48cd-bb90-77784b92af82 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:49.555007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b11d0a-ba0b-48cd-bb90-77784b92af82 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:49.555279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b11d0a-ba0b-48cd-bb90-77784b92af82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:49.556440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b11d0a-ba0b-48cd-bb90-77784b92af82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:49.557874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b11d0a-ba0b-48cd-bb90-77784b92af82 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:49.559544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 33/60] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:49.565074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:49.662367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dbebe-30e6-47ad-93a2-c43bf902eeaf None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:49.695697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d259-3e13-4bc8-af68-1fd250344690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:49.696387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d259-3e13-4bc8-af68-1fd250344690 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:49.696689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d259-3e13-4bc8-af68-1fd250344690 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:49.696969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d259-3e13-4bc8-af68-1fd250344690 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:49.697672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d259-3e13-4bc8-af68-1fd250344690 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:49.699146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d259-3e13-4bc8-af68-1fd250344690 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:49.818155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 28/61] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:36:49 2022] POST /identity/v3/users => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:53.077382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40e972-72c7-43c1-8c0e-801c3cacbc63 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.078894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40e972-72c7-43c1-8c0e-801c3cacbc63 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.079316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40e972-72c7-43c1-8c0e-801c3cacbc63 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.080935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 34/62] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:53.086800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.087626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.088169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.115133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:53.116574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:53.155619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:53.198177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd6f6-adeb-485a-8371-fa0ae98064c7 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.198464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd6f6-adeb-485a-8371-fa0ae98064c7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.198762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd6f6-adeb-485a-8371-fa0ae98064c7 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.200165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 35/63] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:36:53.212202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c6a3-86f2-4fec-bec0-91fa8bd058b2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.212470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c6a3-86f2-4fec-bec0-91fa8bd058b2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.213103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c6a3-86f2-4fec-bec0-91fa8bd058b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.221462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 29/64] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:53.236775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b892c6a3-86f2-4fec-bec0-91fa8bd058b2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:53.238294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b892c6a3-86f2-4fec-bec0-91fa8bd058b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:53.244801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.336477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 36/65] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:53.338049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff655-f2ef-4aa7-bef0-33e8e1f36a16 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.338535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff655-f2ef-4aa7-bef0-33e8e1f36a16 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.339004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff655-f2ef-4aa7-bef0-33e8e1f36a16 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.340677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 37/66] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:53.350612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421baff-2be1-4993-92f2-660148192c21 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.350612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421baff-2be1-4993-92f2-660148192c21 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.350612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421baff-2be1-4993-92f2-660148192c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.376817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3421baff-2be1-4993-92f2-660148192c21 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:53.378044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3421baff-2be1-4993-92f2-660148192c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:53.381745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0aab7-353b-451d-8506-24a7817e1967 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:53.417867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:53.418932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.419377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.419795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.431761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:53.441245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:53.442291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:36:53.443198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:53.445186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 30/67] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:36:53.446195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.450959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 38/68] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:53.451808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421baff-2be1-4993-92f2-660148192c21 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.454126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:53.479332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:53.562222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a77f-0bfd-40ff-9c89-a0b117898d93 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:53.584244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421baff-2be1-4993-92f2-660148192c21 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:53.598253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:53.599083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.599366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.599862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.609716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:53.617380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:53.618219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 31/69] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:53.619363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.625873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:53.626556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.626876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.627162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.627932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:53.628249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:53.629658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8848-7897-494a-afa8-08176c51e321 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:53.639680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 39/70] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:53.641636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b3efb-e005-4d3a-816b-b4edbd1ff205 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.642002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b3efb-e005-4d3a-816b-b4edbd1ff205 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.642345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b3efb-e005-4d3a-816b-b4edbd1ff205 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.648762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 40/71] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:53.648762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b3efb-e005-4d3a-816b-b4edbd1ff205 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.719540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:53.728285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:53.743783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da12d0-6d70-4ef7-b2d7-02fd22f217c5 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:53.767187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b3efb-e005-4d3a-816b-b4edbd1ff205 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:53.779211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:53.780074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.780576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.781029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.792438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:53.801875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:53.802876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:53.803852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 32/72] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:53.804900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.811167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:53.812105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.812429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.813262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.814022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:53.814331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:53.815781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d0d24-726d-4938-aa89-96d57b308fd2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:53.824052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 41/73] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:53.826795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3355b-47b9-4645-9ae8-333e5a2b9c8a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.826795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3355b-47b9-4645-9ae8-333e5a2b9c8a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.826795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3355b-47b9-4645-9ae8-333e5a2b9c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.841434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4fc3355b-47b9-4645-9ae8-333e5a2b9c8a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:53.842650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4fc3355b-47b9-4645-9ae8-333e5a2b9c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:53.911753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128f55-8974-4af5-8d49-3367be121d54 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:53.913095 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 42/74] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:53.914561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e1d8-1e03-4246-981d-55b4e30aeba7 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.914893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e1d8-1e03-4246-981d-55b4e30aeba7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.915176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e1d8-1e03-4246-981d-55b4e30aeba7 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.916553 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 43/75] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:53.917250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2e1d8-1e03-4246-981d-55b4e30aeba7 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.963253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:53.964138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:53.964427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:53.964708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:53.975305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:53.980470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:53.981934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:53.988826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 33/76] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:53.988826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:53.990179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.020084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2e1d8-1e03-4246-981d-55b4e30aeba7 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.054811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.055486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.055771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.056051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.056798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:54.057106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.058483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141b58-8a26-44cf-8b80-897c4c4a6cc7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.066616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 44/77] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:54.067991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.068290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.068630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.086622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc21d-a71b-40f7-852d-8e51d3c8e897 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.086759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:54.087864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:54.121253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.122129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.122415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.122723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.123921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.125366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.127019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 34/78] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:53 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:54.129122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.152433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 45/79] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:54.153122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.201342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.202348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.230887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e858-a249-4666-8fd6-d033356960f9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.250742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a6c9b-0497-44c3-9446-16768879e2ec None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.264424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.265218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.266000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.266295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.267502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.268948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.275656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 35/80] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:54.276813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.284374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.285028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.285323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.285606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.351316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.352802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.372468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a12eb-6308-484c-a012-5b18cf3a1d6f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.399379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.405589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.406489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.406861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.411687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.411687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.411687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.411687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 36/81] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:54.412299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.422731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.453607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 46/82] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:36:54.454441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.509825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640f4a-4c9c-4de3-a081-5932cbe64f98 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.542408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.543151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.543429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.543743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.550478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a850-17f4-4ab2-89e0-77f8ec9ac469 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.584733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.585539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.585818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.586090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.595868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:54.603456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:54.604288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:36:54.605040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 47/83] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:54.605695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.616210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.616425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.617896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.628013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.701634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf37b9-99e6-401b-b585-40116b3152fe None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.715717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 37/84] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:36:54.716539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.739178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.739937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.740226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.740510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.741227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.742723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.813823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3e933-9840-478b-bf25-3686ad5fcbd2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:54.822846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.844320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 48/85] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:36:54 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:36:54.845165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:54.849126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:54.850029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:54.850319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:54.850609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:54.921419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:54.935708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:54.937493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:54.963259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276001-6dc6-4534-b19f-c596dd7b5d41 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.002762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.003640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.004556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.004556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.005407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.006915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.008627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 49/86] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.014416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.049200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 38/87] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:36:55.053778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.065736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:55.151131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf32061-eadc-4f88-a2c1-7bb7d1e84f6c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.179780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55aa6b-38dd-4195-91c9-034b49d05230 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.192429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:55.198718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.199555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.199843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.200418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.201179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:55.201488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.202967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.214525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 50/88] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.216163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.231685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.233430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.233715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.233994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.236280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.239359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.244573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 39/89] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.245956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.327711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:55.333959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfeb1f-af24-4dc1-94f4-75b768947439 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.352658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e8ad-5961-41f7-952e-1f483d7f713b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.369332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.370084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.370449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.370917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.371858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=ba67684123ea44258dad40cd957714e3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:55.372234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.373810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.380262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 51/90] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/role_assignments?user.id=ba67684123ea44258dad40cd957714e3&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.380792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.412108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.413315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.413809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.414254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.419589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.421351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.423463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 40/91] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.431977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.467155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:55.507235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032895fd-9a30-466f-ba0c-72a1d6865e75 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.547848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.548936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.549423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.549831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.551602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.553253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.562994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 52/92] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.562994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.650294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b74b0-2b70-4b48-883d-b9dc20b00a88 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.722326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.723017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.723304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.723656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.724517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=7a61f538ea9c41cc98218141be79ba7b) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:55.724843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.726295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.735486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 41/93] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/role_assignments?user.id=7a61f538ea9c41cc98218141be79ba7b&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.736339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:55.738861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7d57-ad7d-40d7-a39a-1c2d3ed0e943 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:55.769461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:55.789318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:55.809800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:55.810477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:55.810862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:55.811148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:55.812275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] RBAC: Adding query filter params (role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=ba67684123ea44258dad40cd957714e3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:55.813173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:55.814652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:55.826102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 53/94] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/role_assignments?user.id=ba67684123ea44258dad40cd957714e3&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:55.958356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d22ff-bb65-4595-a430-37ad56e2e65c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:56.006626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:56.007635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:56.008115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:56.008589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:56.102193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:56.104033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:56.120856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:56.233574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 42/95] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:36:56.238948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:56.386766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed30b-3e6c-4765-a19f-df66825e059a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:56.438256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615271c5-3259-4274-adb1-03523458ba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:56.439159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615271c5-3259-4274-adb1-03523458ba44 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:56.439447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615271c5-3259-4274-adb1-03523458ba44 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:56.439731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615271c5-3259-4274-adb1-03523458ba44 None admin] PATH_INFO: `/v3/projects/b5d7180fc2c1496292c191508e8d7a9f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:56.441772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615271c5-3259-4274-adb1-03523458ba44 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7180fc2c1496292c191508e8d7a9f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:56.443339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615271c5-3259-4274-adb1-03523458ba44 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:56.445074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 54/96] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:36:56 2022] GET /identity/v3/projects/b5d7180fc2c1496292c191508e8d7a9f => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:56.451067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:56.607555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6a9da-27c3-462c-88bd-6a86ed91c80b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:56.622854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:56.657614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:56.658277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:56.658563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:56.658869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:56.659727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=b5d7180fc2c1496292c191508e8d7a9f, user.id=ba67684123ea44258dad40cd957714e3) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:56.661044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:56.662519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff269-7a12-4091-84ce-3dd74521de5d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:56.670555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 43/97] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:36:56 2022] GET /identity/v3/role_assignments?user.id=ba67684123ea44258dad40cd957714e3&scope.project.id=b5d7180fc2c1496292c191508e8d7a9f&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:57.705643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d918c67-0e67-4272-8827-f287cf68d394 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:57.706164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d918c67-0e67-4272-8827-f287cf68d394 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:57.706237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d918c67-0e67-4272-8827-f287cf68d394 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:57.707632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 55/98] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:57.724017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:57.725025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:57.725533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:57.750478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:57.752113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:57.813484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5abbd6-a95f-4f8d-8495-65a170df5504 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:57.814134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5abbd6-a95f-4f8d-8495-65a170df5504 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:57.814638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5abbd6-a95f-4f8d-8495-65a170df5504 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:57.816240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 56/99] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:57.829625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:57.830151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:57.830715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:57.836883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 44/100] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:57.851427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:57.852629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:57.871685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:57.948636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:57.974308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 57/101] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:58.030742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fab7b-563e-469e-b688-3ee74adf3fc5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:58.032360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:58.049426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:58.110498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:58.111346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.111633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.111908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.113146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:58.114604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:58.116239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 45/102] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:36:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:58.121822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:58.232722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8021d2-9eec-47a0-8e25-997643b5e502 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:58.301430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:58.302234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.302519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.302827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.305391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f193c4-3bec-4767-b395-fac445d24c1f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:58.324255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:58.339203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:58.340073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:36:58.340847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 58/103] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:36:58.356067 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:58.380440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:58.381107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.381394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.381674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.382396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:58.383864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:58.424097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:58.472458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db5d2-b000-47ba-a1f3-22daa6c95980 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:58.506426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:58.507054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.507341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.507619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.508378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:58.508691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:58.510106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:58.519203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 59/104] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:36:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:58.524624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:58.525864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 46/105] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:36:58 2022] POST /identity/v3/projects => generated 302 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:36:58.635363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf0869-7f6c-4ad6-8f84-2e542f3e2a9a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:58.647954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:58.677253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67656c-6c59-45e6-b2bb-890687b2e15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:58.678151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67656c-6c59-45e6-b2bb-890687b2e15d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.678436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67656c-6c59-45e6-b2bb-890687b2e15d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.678744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67656c-6c59-45e6-b2bb-890687b2e15d None admin] PATH_INFO: `/v3/users/162a4d9be4144d9480a0d70cad95a4ed` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.695528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67656c-6c59-45e6-b2bb-890687b2e15d None admin] RBAC: Authorizing `identity:get_user(user_id=162a4d9be4144d9480a0d70cad95a4ed)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:58.697037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67656c-6c59-45e6-b2bb-890687b2e15d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:58.699065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 60/106] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:58 2022] GET /identity/v3/users/162a4d9be4144d9480a0d70cad95a4ed => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:36:58.705101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:58.733510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:58.817595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30749ae9-50f4-4486-bc2e-57433d9cf25b None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.818627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30749ae9-50f4-4486-bc2e-57433d9cf25b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.819120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30749ae9-50f4-4486-bc2e-57433d9cf25b None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.820839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 61/107] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:58.826632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f983de3-442c-48bc-91bb-37db95a06414 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.827203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f983de3-442c-48bc-91bb-37db95a06414 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.827689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f983de3-442c-48bc-91bb-37db95a06414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.835492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f3901-8691-41ed-9005-9c9f385ad0ed None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:58.846137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9f983de3-442c-48bc-91bb-37db95a06414 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:58.847827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9f983de3-442c-48bc-91bb-37db95a06414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:58.916294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:58.917367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.917875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.918347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.965510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 62/108] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:58.967275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2d1e-9e66-42e3-a7aa-26965b74656f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.967784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2d1e-9e66-42e3-a7aa-26965b74656f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.968283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2d1e-9e66-42e3-a7aa-26965b74656f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.969808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 63/109] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:58.977096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:58.977653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:58.977941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:58.996541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:58.997825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:59.013898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:59.016137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:59.071474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.082622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 64/110] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:36:59.099928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.114568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.165363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 47/111] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:36:59.166313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.209655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e77d-8864-4a1d-bfea-4bbe97c0e21f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.247570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457a339-c864-418f-a51b-fb05b5e65691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.248473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457a339-c864-418f-a51b-fb05b5e65691 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.248917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457a339-c864-418f-a51b-fb05b5e65691 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.249288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457a339-c864-418f-a51b-fb05b5e65691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.260815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457a339-c864-418f-a51b-fb05b5e65691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0457a339-c864-418f-a51b-fb05b5e65691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:59.269564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:59.270418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:36:59.271216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 65/112] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:59.271836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395beaa-d269-4288-b9a4-a26a8948221d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.272343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4013-6b0b-4f22-972c-d7b932ee679a None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.273418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4013-6b0b-4f22-972c-d7b932ee679a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.273418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4013-6b0b-4f22-972c-d7b932ee679a None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.275105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 66/113] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:36:59.275897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac4013-6b0b-4f22-972c-d7b932ee679a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.300490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.312718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.314129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.314129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.314386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.325055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:59.333057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:59.334987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:36:59.336974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 48/114] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:59.338082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.384404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.399152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac4013-6b0b-4f22-972c-d7b932ee679a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.438085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a4933-8e62-467b-b190-c85c4e2f274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.439078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4933-8e62-467b-b190-c85c4e2f274c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.439371 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4933-8e62-467b-b190-c85c4e2f274c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.439746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4933-8e62-467b-b190-c85c4e2f274c None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.440954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a4933-8e62-467b-b190-c85c4e2f274c None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:59.442641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a4933-8e62-467b-b190-c85c4e2f274c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:59.444761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 67/115] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:59.445381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0d883-29b4-4218-a2d7-10b7219ddfaa None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.445912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.446258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.446610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.464032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:36:59.465346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:36:59.486976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.487754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.487950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.488221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.488983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:59.489300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:59.490724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:59.499646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 49/116] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:59.500322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.546240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 68/117] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:36:59.547240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.551990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.610724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2439-62a8-4848-a9c8-e82b6a490764 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.644305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.647583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.647583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.647583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.648109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.648861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:59.649178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:59.650576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:59.659958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 50/118] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:59.660781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.661788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf5265-282a-4c37-8afa-197089a25664 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.699900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.700569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.700854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.701168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.702078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] RBAC: Adding query filter params (role.id=c91119ce2e8d46d78127043f274263e9, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=162a4d9be4144d9480a0d70cad95a4ed) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:36:59.702398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:59.704564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:59.710944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 69/119] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/role_assignments?user.id=162a4d9be4144d9480a0d70cad95a4ed&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=c91119ce2e8d46d78127043f274263e9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:59.711645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.805770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b4390-8570-444b-8a7b-02c3a5e040d1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.825607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:36:59.836768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632c5a-3716-4178-bde0-054e89f04bcc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:36:59.887520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.888411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.888704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.888986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.893340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:36:59.894853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:36:59.896608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 51/120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:36:59.897395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:36:59.951358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:36:59.952194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:36:59.952485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:36:59.952762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:36:59.966279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:36:59.975126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:36:59.976035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:36:59.976806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 70/121] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:36:59.977420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.000535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:00.031906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfb434-0635-4978-b887-697b21d7713d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.071034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.071927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.072272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.072561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.073834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.075410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.077059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 52/122] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:00.077915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.126005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc34e1b-13e7-4a6d-9325-13882f2b997c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.139961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:00.164990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6100545-87cd-416d-968c-b0f640c5e917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.165850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100545-87cd-416d-968c-b0f640c5e917 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.166121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100545-87cd-416d-968c-b0f640c5e917 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.166404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100545-87cd-416d-968c-b0f640c5e917 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.170759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6100545-87cd-416d-968c-b0f640c5e917 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.170759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6100545-87cd-416d-968c-b0f640c5e917 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.172835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 71/123] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:36:59 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:00.174090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376080-8134-4d40-a41c-f3c8ad21a93a None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.174384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376080-8134-4d40-a41c-f3c8ad21a93a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.174697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376080-8134-4d40-a41c-f3c8ad21a93a None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.176097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 72/124] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:00.176652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40376080-8134-4d40-a41c-f3c8ad21a93a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.213029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bde3ec-6f65-447a-87a8-2bf9708610cc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.255385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.256505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.257080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.257367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.258377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:00.258721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.260812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.272552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 53/125] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:00.274012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.277926 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:00.300541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40376080-8134-4d40-a41c-f3c8ad21a93a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.337345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5378a2-3d28-42d2-ba08-8b4c3f76db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.338408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5378a2-3d28-42d2-ba08-8b4c3f76db5f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.338775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5378a2-3d28-42d2-ba08-8b4c3f76db5f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.339444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5378a2-3d28-42d2-ba08-8b4c3f76db5f None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.340650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5378a2-3d28-42d2-ba08-8b4c3f76db5f None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.342185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5378a2-3d28-42d2-ba08-8b4c3f76db5f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.343969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 73/126] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:00 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:00.349657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.350082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.350270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.368137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:00.369642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:00.405802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c6dcf-7810-4353-ae23-f251c0f38567 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.409651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:00.443552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.445011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.445544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.446136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/7a61f538ea9c41cc98218141be79ba7b/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.448891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6659d44dde4309adb297408b0a6c4c, user_id=7a61f538ea9c41cc98218141be79ba7b, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.450700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.454493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 74/127] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:00.459377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.537904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:00.540152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 54/128] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:00 2022] PUT /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/7a61f538ea9c41cc98218141be79ba7b/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:00.541533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.573939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d69388-66fb-40c9-873f-862bac6e6fee None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.639309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.640261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.640575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.641318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.643191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.644828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.652942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 75/129] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:00 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:00.652942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.679140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4e046-cfac-4502-9da0-df8ed33a48bb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.723262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.724574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.725080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.725563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/ba67684123ea44258dad40cd957714e3/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.727924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6659d44dde4309adb297408b0a6c4c, user_id=ba67684123ea44258dad40cd957714e3, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:00.729627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:00.813814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c2a-9a52-43fa-bab3-917e44e9ef62 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:00.854135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:00.855033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:00.855326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:00.855610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:00.862799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 55/130] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:00 2022] PUT /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/ba67684123ea44258dad40cd957714e3/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:00.864205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.884785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:00.898367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:00.899384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:00.900605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 76/131] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:00.907428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:00.914310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:00.926988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:01.095762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d17db-0659-40f2-a1e1-b2e31a2723c0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.147005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aa1af-d506-4306-a3d9-81314fc55cc7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.161919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.162826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.163174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.163463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.167340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:01.168824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:01.170812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 56/132] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:00 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:01.191267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:01.191555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.192293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.192590 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.192877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.193666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:01.194042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:01.195498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:01.204630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 77/133] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:01.210557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:01.311019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:01.334898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573c28-e8b3-4dcb-b44a-e400afe6a96c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.338946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:01.352849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd5243-0a40-49af-a89f-fd6f491ea0c0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.402545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0bd28-22a4-4b1e-818e-6fbee5f6b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.403467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bd28-22a4-4b1e-818e-6fbee5f6b435 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.403757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bd28-22a4-4b1e-818e-6fbee5f6b435 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.404040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bd28-22a4-4b1e-818e-6fbee5f6b435 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.404741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2f736-a474-4600-b832-638ff6892aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.405697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2f736-a474-4600-b832-638ff6892aeb None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.406509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2f736-a474-4600-b832-638ff6892aeb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.406832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2f736-a474-4600-b832-638ff6892aeb None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/ba67684123ea44258dad40cd957714e3/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.408048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0bd28-22a4-4b1e-818e-6fbee5f6b435 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:01.409514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0bd28-22a4-4b1e-818e-6fbee5f6b435 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:01.411205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 78/134] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:01 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:01.414041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2f736-a474-4600-b832-638ff6892aeb None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6659d44dde4309adb297408b0a6c4c, user_id=ba67684123ea44258dad40cd957714e3, role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:01.415728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2f736-a474-4600-b832-638ff6892aeb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:01.417478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb3cc-6080-464f-a40a-8d7282d420c9 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.417783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb3cc-6080-464f-a40a-8d7282d420c9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.418066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb3cc-6080-464f-a40a-8d7282d420c9 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.419417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 79/135] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:01.420132 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb3cc-6080-464f-a40a-8d7282d420c9 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:01.502534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 57/136] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:01 2022] PUT /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/ba67684123ea44258dad40cd957714e3/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:01.503920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.504369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.504539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.543793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:01.545119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:01.547872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb3cc-6080-464f-a40a-8d7282d420c9 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.587203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.588594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.589150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.589619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] PATH_INFO: `/v3/projects/b5d7180fc2c1496292c191508e8d7a9f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.591099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7180fc2c1496292c191508e8d7a9f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:01.592909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:01.595623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 80/137] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:01 2022] GET /identity/v3/projects/b5d7180fc2c1496292c191508e8d7a9f => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:01.604120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:01.607484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:01.716188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 58/138] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:01.753343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:01.769758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097ed58-eff6-4d46-8a79-1c8652ff2813 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.809230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.810625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.811139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.811610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] PATH_INFO: `/v3/projects/b5d7180fc2c1496292c191508e8d7a9f/users/ba67684123ea44258dad40cd957714e3/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.815022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7180fc2c1496292c191508e8d7a9f, user_id=ba67684123ea44258dad40cd957714e3, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:01.816991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:01.916190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:01.935856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 81/139] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:01 2022] PUT /identity/v3/projects/b5d7180fc2c1496292c191508e8d7a9f/users/ba67684123ea44258dad40cd957714e3/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:01.943222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834bab6-628c-4efc-a51b-1eae4bcf8f42 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:01.995745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8582d-d281-4088-9290-ab88fec0cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:01.996899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8582d-d281-4088-9290-ab88fec0cf80 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:01.997408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8582d-d281-4088-9290-ab88fec0cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:01.997881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8582d-d281-4088-9290-ab88fec0cf80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:01.999805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8582d-d281-4088-9290-ab88fec0cf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:02.002120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8582d-d281-4088-9290-ab88fec0cf80 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:02.003950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 59/140] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:02.009780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:02.104084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:02.155901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f61d-5655-4063-b506-49a77fe7d623 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:02.201173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:02.201874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:02.202153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:02.202432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:02.203766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:02.205264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:02.270652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83905c46-e594-4acc-9b95-da655b5aca66 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:02.270652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83905c46-e594-4acc-9b95-da655b5aca66 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:02.271126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83905c46-e594-4acc-9b95-da655b5aca66 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:02.272758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 60/141] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:02.279030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:02.279619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:02.280097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:02.298109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:02.299672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:02.346564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 82/142] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:02 2022] POST /identity/v3/users => generated 283 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:02.383864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 61/143] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:02.410146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:02.522521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda2be-c6c8-4719-93dd-01aab89307ea None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:02.540720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:02.560290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:02.561496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:02.562873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:02.563369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:02.575283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:02.584763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:02.585647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:02.586391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:02.594255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 83/144] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:02.596129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:02.683996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:02.704312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa6b3-43c9-4d00-b28f-1aead60baeae None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:02.739404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:02.740083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:02.740372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:02.740653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:02.741527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:02.741849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:02.744678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:02.756844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 62/145] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:02.767676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:02.896679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbd5a-f1c4-4802-87cd-96ad56a6fe49 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:02.932669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:02.933550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:02.933830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:02.934160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] PATH_INFO: `/v3/users/162a4d9be4144d9480a0d70cad95a4ed` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:02.935344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] RBAC: Authorizing `identity:get_user(user_id=162a4d9be4144d9480a0d70cad95a4ed)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:02.937057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:02.942691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 84/146] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:02 2022] GET /identity/v3/users/162a4d9be4144d9480a0d70cad95a4ed => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:02.944560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:03.065863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d81137-f346-43e7-ae45-ecfdf4ab0408 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:03.110199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920eeec-4d8e-448d-a9b1-8a093dda7a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:03.111117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920eeec-4d8e-448d-a9b1-8a093dda7a72 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:03.111407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920eeec-4d8e-448d-a9b1-8a093dda7a72 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:03.111690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920eeec-4d8e-448d-a9b1-8a093dda7a72 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:03.112928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920eeec-4d8e-448d-a9b1-8a093dda7a72 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:03.114386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920eeec-4d8e-448d-a9b1-8a093dda7a72 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:03.116441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 63/147] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:02 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:03.122133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:03.199128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:03.274075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541a38-92d3-44e6-a60b-948be447da45 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:03.317691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c7793-6a1d-46f2-b67b-2cff7376bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:03.318579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c7793-6a1d-46f2-b67b-2cff7376bab2 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:03.318885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c7793-6a1d-46f2-b67b-2cff7376bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:03.319161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c7793-6a1d-46f2-b67b-2cff7376bab2 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/162a4d9be4144d9480a0d70cad95a4ed/roles/c91119ce2e8d46d78127043f274263e9` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:03.321126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c7793-6a1d-46f2-b67b-2cff7376bab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6659d44dde4309adb297408b0a6c4c, user_id=162a4d9be4144d9480a0d70cad95a4ed, role_id=c91119ce2e8d46d78127043f274263e9)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:03.322608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c7793-6a1d-46f2-b67b-2cff7376bab2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:03.398954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 85/148] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:03 2022] PUT /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c/users/162a4d9be4144d9480a0d70cad95a4ed/roles/c91119ce2e8d46d78127043f274263e9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:03.740163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed4e72-a4cb-47ef-b369-57b0e88ec8ab None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:03.740552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed4e72-a4cb-47ef-b369-57b0e88ec8ab None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:03.740741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed4e72-a4cb-47ef-b369-57b0e88ec8ab None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:03.742263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 64/149] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:03.747660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240285-8a95-4d12-858f-8194021262c9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:03.747951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240285-8a95-4d12-858f-8194021262c9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:03.748231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240285-8a95-4d12-858f-8194021262c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:03.771909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-0d240285-8a95-4d12-858f-8194021262c9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:03.773146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0d240285-8a95-4d12-858f-8194021262c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:03.856121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 86/150] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:03.872806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5df8-e185-4346-bd19-cbe0607b68d4 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:03.873106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5df8-e185-4346-bd19-cbe0607b68d4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:03.873394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5df8-e185-4346-bd19-cbe0607b68d4 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:03.874834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 65/151] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:03.885652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:03.885952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:03.886238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:03.893340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5df8-e185-4346-bd19-cbe0607b68d4 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:03.907748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:03.913393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:03.914574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:03.965795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:04.033288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 87/152] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:04.043343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5df8-e185-4346-bd19-cbe0607b68d4 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.085678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.086858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.087356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.087992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.100594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:04.108969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:04.109903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:04.110718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:04.113170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 66/153] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:04.119010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.120667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.204789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:04.238298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052a20-803a-4032-b8c2-d051ce35a6eb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.273509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.274718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.275225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.275706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.291794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:04.304055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:04.305194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:04.306032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:04.311150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede9a4f-5c22-4513-b6aa-42a73ecac225 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.314102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 67/154] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:04.320863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.408536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.409226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.409515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.409794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.410569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:04.410908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:04.412309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:04.425486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 88/155] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:04.441757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d8b1-2f80-4829-8972-b7054dea242b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.448819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.473286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:04.479533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.480336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.480735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.481119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.481996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:04.482416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:04.483928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:04.495753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 68/156] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:04.499045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:04.500613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.607345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a58d-02d2-46ff-8786-d5d2d18c9457 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.610243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afc600-07c8-468f-b8f4-ba5f1ba4147d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.643859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.645691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.645691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.646031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.647719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:04.649364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:04.651675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 69/157] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:04.658777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.687645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.688536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.688821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.689097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] PATH_INFO: `/v3/users/7a61f538ea9c41cc98218141be79ba7b` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.690623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] RBAC: Authorizing `identity:get_user(user_id=7a61f538ea9c41cc98218141be79ba7b)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:04.691857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:04.693844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 89/158] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/users/7a61f538ea9c41cc98218141be79ba7b => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:04.720344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:04.730935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:04.772600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80994-41ad-4f09-96e8-35c551fb4801 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.809927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:04.810974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:04.811450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:04.812212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:04.895060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:04.896796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:04.927861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998a337-e94e-4ab0-8349-152413dc584b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:04.929564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:04.995328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:05.007420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:05.008096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.008394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.008683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.030344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 70/159] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:05.039701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:05.115582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:05.117093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:05.172277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671391bd-0e66-4822-98d4-94dc9a53ad4e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:05.207379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc545c-3c05-41ff-ba3b-1ba381182131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:05.208237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc545c-3c05-41ff-ba3b-1ba381182131 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.208519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc545c-3c05-41ff-ba3b-1ba381182131 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.208944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc545c-3c05-41ff-ba3b-1ba381182131 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.210188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc545c-3c05-41ff-ba3b-1ba381182131 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:05.211693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc545c-3c05-41ff-ba3b-1ba381182131 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:05.214076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 71/160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:05 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:05.215305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583ad5-90f0-400a-b9e8-f94646ef7d59 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.215591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583ad5-90f0-400a-b9e8-f94646ef7d59 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.215867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583ad5-90f0-400a-b9e8-f94646ef7d59 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.217084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 72/161] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:05.222750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.223040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.223319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.241278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:05.242475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:05.278944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:05.322504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 90/162] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:05.323395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:05.324059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:05.368266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 73/163] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:05.369116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:05.474952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfa27-b433-4028-b762-b9451a530bde None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:05.511239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:05.512110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.512387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.512657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.513882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:05.515924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:05.517659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 74/164] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:05 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:05.518429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:05.595088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:05.619122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3479c6-d7e9-4ea0-a093-2b41ce72fd2c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:05.656348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de51b4f-56f7-437b-b149-c530e4e7a5fa None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:05.709760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:05.710774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.711053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.711321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.727439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:05.728037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.728323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.728491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:05.728582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.729427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=ba67684123ea44258dad40cd957714e3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:05.729741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:05.731283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:05.741699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:05.742631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 75/165] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:05.744038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:05.745421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 91/166] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:05 2022] GET /identity/v3/role_assignments?user.id=ba67684123ea44258dad40cd957714e3&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 608 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:05.751529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:05.897898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76080f7-f633-44e6-8539-7e2a5e070044 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:05.926992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:05.927201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:05.934517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:05.935507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:05.935947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:05.936372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:05.937649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=7a61f538ea9c41cc98218141be79ba7b) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:05.938112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:05.939730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:05.946281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 76/167] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:05 2022] GET /identity/v3/role_assignments?user.id=7a61f538ea9c41cc98218141be79ba7b&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:06.023297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49eca-2da7-44b4-b920-7a4a0f7a3325 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:06.071237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:06.071914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.072195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.072472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.073231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:06.073601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:06.075079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7479f5-0aac-4df5-a221-35654f23aece None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:06.091655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 92/168] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:06.097785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:06.126987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8aa73-e218-4027-a370-6dee964d453c None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.127203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8aa73-e218-4027-a370-6dee964d453c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.127454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8aa73-e218-4027-a370-6dee964d453c None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.129149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 93/169] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:06.134547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.134907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.135241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.160828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:06.162042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:06.283857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 94/170] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:06.306389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb795f4-e44a-4707-b538-908f0966b15a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:06.341446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:06.353871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:06.354781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.355065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.355342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.356532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:06.358028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:06.359801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 77/171] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:06 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:06.365287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:06.386240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:06.443863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:06.502275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858daa8-fd30-4789-84d9-d9c5e100f703 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:06.534986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597dde1-2392-4b88-9e03-b34bc0a18e6e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:06.540489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:06.541291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.541570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.541840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.552760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:06.561004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:06.562210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:06.563111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 95/172] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:06.568483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:06.616979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:06.617523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.617810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.618088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.682377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586221-d5f5-4039-ad6a-ca9b4c1c9b4f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:06.698337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:06.721895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:06.722851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.723136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.723404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.724160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:06.724468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:06.725954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:06.735343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 96/173] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:06.742130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:06.791748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:06.793156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:06.839844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:06.849805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b26f69-c53f-450d-b9df-365544a1793a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:06.890938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:06.890938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:06.890938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:06.890938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] PATH_INFO: `/v3/users/ba67684123ea44258dad40cd957714e3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:06.891313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] RBAC: Authorizing `identity:get_user(user_id=ba67684123ea44258dad40cd957714e3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:06.892891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:06.898770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 97/174] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:06 2022] GET /identity/v3/users/ba67684123ea44258dad40cd957714e3 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:06.900290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:06.946841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:07.010368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 78/175] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:07.012123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6f8f5-fe5f-4734-9d9a-a92602004283 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:07.027935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:07.049908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:07.051178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.051603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.052118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.125677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:07.127417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:07.163630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866ac8-14a1-4d39-8ffa-a066a975b183 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:07.172288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:07.181543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:07.215286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:07.216166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.216453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.216733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.217971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:07.219472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:07.226163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 79/176] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:07 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:07.240258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:07.242906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 98/177] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:07.248827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:07.354935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05dd84-31f9-4065-9edb-9aa60654dcac None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:07.392105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:07.393233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.393657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.394176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] PATH_INFO: `/v3/projects/b5d7180fc2c1496292c191508e8d7a9f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.395633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7180fc2c1496292c191508e8d7a9f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:07.397323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:07.399318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 99/178] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:07 2022] GET /identity/v3/projects/b5d7180fc2c1496292c191508e8d7a9f => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:07.400728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af541f67-d2bf-4556-94e6-d1cba5fd7f76 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:07.418083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:07.441770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:07.505349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:07.506496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.507019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.507641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.510053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] RBAC: Adding query filter params (role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=ba67684123ea44258dad40cd957714e3) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:07.516884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:07.518790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13719012-100a-4465-92b9-6af210e3f61f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:07.529944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 80/179] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:07 2022] GET /identity/v3/role_assignments?user.id=ba67684123ea44258dad40cd957714e3&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:07.595480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b5cc-6d06-4dc7-b97a-5ca6004165ca None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.596132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b5cc-6d06-4dc7-b97a-5ca6004165ca None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.596614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b5cc-6d06-4dc7-b97a-5ca6004165ca None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.598193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 81/180] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:07.600283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a896-2510-4771-b10a-e94aff2811af None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:07.603764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.604275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.604766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.634613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:07.635755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:07.673875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:07.674543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.674909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.675186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.676090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=b5d7180fc2c1496292c191508e8d7a9f, user.id=ba67684123ea44258dad40cd957714e3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:07.676405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:07.677890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80bc5-8040-43e1-a038-8d4f78df1ba1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:07.693293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 100/181] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:07 2022] GET /identity/v3/role_assignments?user.id=ba67684123ea44258dad40cd957714e3&scope.project.id=b5d7180fc2c1496292c191508e8d7a9f&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:07.694693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d0d8e-6191-4799-b300-b4d1f22cd1a9 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.694982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d0d8e-6191-4799-b300-b4d1f22cd1a9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.695257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d0d8e-6191-4799-b300-b4d1f22cd1a9 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.696586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 101/182] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:07.704691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:07.705023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:07.705241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:07.748287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:07.749510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:07.753532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:07.791270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 82/183] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:07.828433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:07.885123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 102/184] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:07.927224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:07.930373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.011874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff193d3-5dbd-45e2-9b7d-f8350b6842ad None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.056533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962db65-b8b0-4a31-a5e0-e55aad65eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.057805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962db65-b8b0-4a31-a5e0-e55aad65eda6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.058096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962db65-b8b0-4a31-a5e0-e55aad65eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.058375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962db65-b8b0-4a31-a5e0-e55aad65eda6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.071867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962db65-b8b0-4a31-a5e0-e55aad65eda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:08.077695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fdc3-a8c9-4a6e-8136-6c289a7e957f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-8962db65-b8b0-4a31-a5e0-e55aad65eda6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:08.081111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:08.082008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 83/185] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:08.083474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c743b9f-5213-4a44-bbab-46a8683422d9 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.084203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c743b9f-5213-4a44-bbab-46a8683422d9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.084203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c743b9f-5213-4a44-bbab-46a8683422d9 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.085146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 84/186] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:08.091193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.091439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.091612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.112878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:08.114081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:08.121925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.123213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.123506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.123773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.137908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:08.148955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:08.149907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:08.150758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:08.151853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 103/187] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:08.152310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.152410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.186119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 85/188] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:08.194830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.218788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.262647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32dff2-d272-4b0f-b452-7c23d2befd39 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.298236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.298932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.299215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.299495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.300235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:08.300542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.301929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:08.308737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563a6c-ad9e-4555-bbcf-97eb36773561 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.309707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 104/189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:08.310476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.344339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.345009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.345301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.345582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.346331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:08.346672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.348058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aebe78-162d-4cf5-93da-19133ecdbe31 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:08.356421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 86/190] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:08.357702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1a39-3fa5-40f7-bc47-4370b087576f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.357996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1a39-3fa5-40f7-bc47-4370b087576f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.358299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1a39-3fa5-40f7-bc47-4370b087576f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.359820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 87/191] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:08.363380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d1a39-3fa5-40f7-bc47-4370b087576f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.394889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.408088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3d38-e2de-4650-9178-88ec6745a7c9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.432229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.441343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.442150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.442434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.442757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.452859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:08.461973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:08.463046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:08.464022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:08.464753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d1a39-3fa5-40f7-bc47-4370b087576f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.466849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 105/192] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:08.469793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.495786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d4703-1748-4b72-8168-eb01e5da0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.496650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4703-1748-4b72-8168-eb01e5da0b94 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.496926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4703-1748-4b72-8168-eb01e5da0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.497195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4703-1748-4b72-8168-eb01e5da0b94 None admin] PATH_INFO: `/v3/users/14660d8429f14493ac39717d5e628687` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.510806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4703-1748-4b72-8168-eb01e5da0b94 None admin] RBAC: Authorizing `identity:get_user(user_id=14660d8429f14493ac39717d5e628687)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.512325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4703-1748-4b72-8168-eb01e5da0b94 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:08.513994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 88/193] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/users/14660d8429f14493ac39717d5e628687 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:08.515181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.516011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.516293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.531827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:08.533010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:08.565071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3d13e-eda4-412c-9ae2-94d3714b5bfb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.597627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.600893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 89/194] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:08.601004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.601004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.601170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.601262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] PATH_INFO: `/v3/users/162a4d9be4144d9480a0d70cad95a4ed` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.601262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] RBAC: Authorizing `identity:get_user(user_id=162a4d9be4144d9480a0d70cad95a4ed)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.601772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:08.603423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 106/195] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/users/162a4d9be4144d9480a0d70cad95a4ed => generated 289 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:08.608411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.627965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.666251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.704388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a6ba-3acd-4959-8862-009da5f093fc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.710527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64682d-7541-4eda-a2a2-5ddc33ea09f6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.737433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.738088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.738368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.738733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.739544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:08.739850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.741204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:08.743275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.743910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.744195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.744472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.749034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 90/196] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:08.750389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.811100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.813397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:08.832287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.851331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b41446-46c2-4cd6-a9b5-5d614e92cad0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:08.865570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:08.890565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:08.891309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:08.891677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:08.892015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:08.918360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 107/197] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:08.919207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:08.958377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:08.959878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.016495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5981c7-1c58-4c57-a4c3-c06630086cbe None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.037075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.049613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.052079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.052079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.052079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.052079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.053550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.055186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 108/198] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.056022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 91/199] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:09.056129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.056883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.079856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.152930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25328-9694-4744-bf1c-ba4742964010 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.156988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1b294-66b2-476a-8f0c-2dbe00454417 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.188209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.188997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.189276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.189548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] PATH_INFO: `/v3/users/14660d8429f14493ac39717d5e628687` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.190759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] RBAC: Authorizing `identity:get_user(user_id=14660d8429f14493ac39717d5e628687)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.192198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.193808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 109/200] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/users/14660d8429f14493ac39717d5e628687 => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.194535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.198958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.199826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.200108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.200382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.201577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.203066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.204758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 92/201] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.205508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.254260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.283466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.293292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174728d-6fa1-4f6f-94f8-237f22aa9da2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.302667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c054-9d86-443e-888e-465ca09ada9d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.334654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.335319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.335598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.335873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.336568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.337419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.337994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.338304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.338617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.338885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.340068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.341485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.343212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 93/202] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.344612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.412320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 110/203] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:09 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:09.413402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.456720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c97e5-9343-41e7-830b-73752e34c862 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.477475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.494462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.495148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.495432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.495707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.530185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8f2e2-3160-475e-b291-628d67519ae7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.574306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.575300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.575838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.575941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.576726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.576726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.577532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=14660d8429f14493ac39717d5e628687) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:09.578391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.579858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.586366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 111/204] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/role_assignments?user.id=14660d8429f14493ac39717d5e628687&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.587207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.604611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.725961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 94/205] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:09.732568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:09.735081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933ee8e-55ad-4694-bb07-72e1b7676c63 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.755546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:09.784863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.785914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.786400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.786842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.788465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] RBAC: Adding query filter params (role.id=c91119ce2e8d46d78127043f274263e9, scope.project.id=1b6659d44dde4309adb297408b0a6c4c, user.id=162a4d9be4144d9480a0d70cad95a4ed) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:09.788949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.790990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.799091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 112/206] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/role_assignments?user.id=162a4d9be4144d9480a0d70cad95a4ed&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=c91119ce2e8d46d78127043f274263e9 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.868853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5491e8-973c-4958-9363-f91290f6a307 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:09.918040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f32011-1d67-4706-b3a6-994a1ad75e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:09.919058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32011-1d67-4706-b3a6-994a1ad75e78 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:09.919346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32011-1d67-4706-b3a6-994a1ad75e78 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:09.919623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32011-1d67-4706-b3a6-994a1ad75e78 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:09.922425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f32011-1d67-4706-b3a6-994a1ad75e78 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:09.924012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f32011-1d67-4706-b3a6-994a1ad75e78 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:09.926214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 95/207] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:09.932053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:10.026432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:10.052082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb1dcc-571c-418f-bc38-942c46c99620 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:10.087947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:10.088683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:10.088885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:10.089166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:10.090007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] RBAC: Adding query filter params (role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=14660d8429f14493ac39717d5e628687) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:10.090320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:10.091897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da522f-d1ff-4ba8-92eb-9e21b2a5bba2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:10.102753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 113/208] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:09 2022] GET /identity/v3/role_assignments?user.id=14660d8429f14493ac39717d5e628687&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:11.824265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebd07c-8557-4a60-b66e-fb3f9df26394 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:11.824815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebd07c-8557-4a60-b66e-fb3f9df26394 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:11.824815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebd07c-8557-4a60-b66e-fb3f9df26394 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:11.826171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 96/209] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:11.830390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa63c-104c-4b46-893b-6ccd05a17e78 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:11.831291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa63c-104c-4b46-893b-6ccd05a17e78 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:11.831806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa63c-104c-4b46-893b-6ccd05a17e78 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:11.832131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:11.832419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:11.832697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:11.834290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 114/210] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:11.839290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:11.839826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:11.840307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:11.852058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:11.853249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:11.863463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:11.864965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:11.943456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 97/211] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:11.952468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 115/212] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:11.969772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:11.975890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:11.988552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.041041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.081138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f198-12b1-4dd4-a70e-edcd11f66f73 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.081582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98235-af3d-462d-96cb-d4bc58691c5f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.116545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f2b1a-9b8e-484c-8c6c-400ba1147a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.117337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f2b1a-9b8e-484c-8c6c-400ba1147a9d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.117611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f2b1a-9b8e-484c-8c6c-400ba1147a9d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.117888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f2b1a-9b8e-484c-8c6c-400ba1147a9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.120696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33445f-3ec9-42ef-b2f0-b3cc793e83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.121499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33445f-3ec9-42ef-b2f0-b3cc793e83cc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.121785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33445f-3ec9-42ef-b2f0-b3cc793e83cc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.122058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33445f-3ec9-42ef-b2f0-b3cc793e83cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.129609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f2b1a-9b8e-484c-8c6c-400ba1147a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:12.133532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33445f-3ec9-42ef-b2f0-b3cc793e83cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-ae6f2b1a-9b8e-484c-8c6c-400ba1147a9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:12.139362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:12.140227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:12.146811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 116/213] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-fa33445f-3ec9-42ef-b2f0-b3cc793e83cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:12.147467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:12.148265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:12.150944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:12.152410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac04b2-c623-40bb-858f-6cd75b7a3097 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.152410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac04b2-c623-40bb-858f-6cd75b7a3097 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.152659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 98/214] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:12.152791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac04b2-c623-40bb-858f-6cd75b7a3097 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.152791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 117/215] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:12.153022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.153022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.153022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.153451 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac04b2-c623-40bb-858f-6cd75b7a3097 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.167924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:12.169219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:12.240599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 99/216] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:12.241449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.256396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.265852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac04b2-c623-40bb-858f-6cd75b7a3097 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.291374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.299529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.300191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.300480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.300764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.301514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:12.301824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.303251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecacde8-1e24-466a-ac65-8068bbbaac9f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.311523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 118/217] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:12.315248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539c298-655f-493e-8ee8-87881eec8992 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.315773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539c298-655f-493e-8ee8-87881eec8992 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.316186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539c298-655f-493e-8ee8-87881eec8992 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.317830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 119/218] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:12.319263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539c298-655f-493e-8ee8-87881eec8992 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.347236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014d122-b82a-4bb5-8cad-cc2251dbe77f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.381296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.381966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.382236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.382515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.383282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:12.383585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.384941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.393001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 100/219] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:12.393951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.423194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539c298-655f-493e-8ee8-87881eec8992 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.456973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60630-2735-4e29-829f-6ffd3eac44cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.457761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60630-2735-4e29-829f-6ffd3eac44cd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.458050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60630-2735-4e29-829f-6ffd3eac44cd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.458170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.458330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60630-2735-4e29-829f-6ffd3eac44cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.459522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60630-2735-4e29-829f-6ffd3eac44cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.460965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60630-2735-4e29-829f-6ffd3eac44cd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.462776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 120/220] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:12.463720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.464007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.464282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.480504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:12.481671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:12.491424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85196-c852-435d-ad37-29e098ce32b2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.523912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.524877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.525164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.525439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] PATH_INFO: `/v3/users/0e7dd52f8284444c8214cc42ff133b9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.532889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.538767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] RBAC: Authorizing `identity:get_user(user_id=0e7dd52f8284444c8214cc42ff133b9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.540263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.542090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 101/221] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/users/0e7dd52f8284444c8214cc42ff133b9a => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:12.542704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.550097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 121/222] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:12.555447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.691133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b53dc-3602-484e-a53d-e14a7226c184 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.716830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.725163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e839b61-b603-4396-b253-254250eff771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.725936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e839b61-b603-4396-b253-254250eff771 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.726043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895873d4-b2b3-4016-8088-d0277c845d51 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.726216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e839b61-b603-4396-b253-254250eff771 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.726489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e839b61-b603-4396-b253-254250eff771 None admin] PATH_INFO: `/v3/users/14660d8429f14493ac39717d5e628687` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.727713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e839b61-b603-4396-b253-254250eff771 None admin] RBAC: Authorizing `identity:get_user(user_id=14660d8429f14493ac39717d5e628687)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.729160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e839b61-b603-4396-b253-254250eff771 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.735404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 102/223] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/users/14660d8429f14493ac39717d5e628687 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:12.735404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e839b61-b603-4396-b253-254250eff771 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.759909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.760568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.760843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.761116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.761810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.763286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.829586 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e839b61-b603-4396-b253-254250eff771 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:12.861639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:12.862360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:12.862666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:12.862951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:12.869106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 122/224] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:12 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:12.869106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:12.927196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.946093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:12.949794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:12.951452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:12.991063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052698-c2ef-4c5d-9ab6-cf1228363174 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.029608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.030614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.031446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.031730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.043435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:13.052265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:13.053167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:13.053973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 123/225] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:13.054689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.074547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 103/226] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:13.075476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.190851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5748-76ea-4aef-a78d-52d69d32cea9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.194742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:13.201767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:13.209666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209fd7-92db-49c5-977d-9b0b9c954f5a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.229107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.229977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.230256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.230530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.232173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.234417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.236366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 124/227] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:13 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:13.237327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.261578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.264151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.264666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.265894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.267697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:13.268205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.270707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.282031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 104/228] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:13.283871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.363983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56813478-1a7f-427f-b42d-1bb0200594c5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.399404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.400176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.400457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.400773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.401970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.403700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.410113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 125/229] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:13 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:13.410113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.422577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f35d4-b523-44d3-b49b-af8a8b2b3e0d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.466988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:13.467180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.467180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.467180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.467180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/14660d8429f14493ac39717d5e628687/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.467479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=750d4f09b0cd427fabbdc2703cc34e9a, user_id=14660d8429f14493ac39717d5e628687, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.467731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.513859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508b87-8a6d-433f-9757-d11e104b95ca None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.548760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.549640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.549921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.550197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] PATH_INFO: `/v3/users/14660d8429f14493ac39717d5e628687` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.551419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] RBAC: Authorizing `identity:get_user(user_id=14660d8429f14493ac39717d5e628687)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.552867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.559082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 126/230] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:13 2022] GET /identity/v3/users/14660d8429f14493ac39717d5e628687 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:13.559918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.568581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 105/231] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:13 2022] PUT /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/14660d8429f14493ac39717d5e628687/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:13.570038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.608717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:13.727888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d42528-8888-4514-ac7a-02adad2547d8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.770717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.772029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.772506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.773023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.774501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.776395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.778998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 106/232] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:13 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:13.786003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:13.818296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0c7a7-e915-4b33-aad9-229ac26b0b10 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.828261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:13.858283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.859899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.860392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.860895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.861937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=0e7dd52f8284444c8214cc42ff133b9a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:13.862474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.864820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a206f-f263-41e4-a389-b14087507d94 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:13.870916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 127/233] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:13 2022] GET /identity/v3/role_assignments?user.id=0e7dd52f8284444c8214cc42ff133b9a&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:13.903029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:13.922310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b60f-f04d-457c-b0f9-7ff21f0ecaa4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:13.961503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e31537-a635-4fc7-8e43-cdc5ece39c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:13.962409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31537-a635-4fc7-8e43-cdc5ece39c40 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:13.962715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31537-a635-4fc7-8e43-cdc5ece39c40 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:13.962993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31537-a635-4fc7-8e43-cdc5ece39c40 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/14660d8429f14493ac39717d5e628687/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:13.965328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e31537-a635-4fc7-8e43-cdc5ece39c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=750d4f09b0cd427fabbdc2703cc34e9a, user_id=14660d8429f14493ac39717d5e628687, role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:13.966887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e31537-a635-4fc7-8e43-cdc5ece39c40 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:14.076134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 107/234] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:13 2022] PUT /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/14660d8429f14493ac39717d5e628687/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:15.304839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07402-5cf4-4d33-86c9-fb9b14681c36 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:15.305363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07402-5cf4-4d33-86c9-fb9b14681c36 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:15.305439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07402-5cf4-4d33-86c9-fb9b14681c36 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:15.307072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 128/235] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:15.320327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:15.321345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:15.321822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:15.347708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:15.349254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:15.378361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41980-4be6-4607-a025-09e0000b73ee None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:15.378701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41980-4be6-4607-a025-09e0000b73ee None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:15.378982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41980-4be6-4607-a025-09e0000b73ee None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:15.380615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 129/236] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:15.385377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:15.385668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:15.385955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:15.416838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:15.418054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:15.430480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 108/237] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:15.495649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:15.509393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 130/238] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:15.563145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:15.591040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:15.622081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad865e-127c-4180-9367-421dbfb5d7d9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:15.727486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:15.729518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:15.732357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:15.732785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:15.763722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:15.784552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314318-c50e-4105-a296-df7b21f1de51 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:15.784969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:15.786064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:15.787062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 109/239] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:15.789696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:15.793400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:15.835908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:15.836970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:15.837395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:15.837814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:15.841490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:15.843182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:15.845444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 131/240] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:15.850676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:15.946420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956a057-944d-4932-ba2d-1e5fa35a367d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:16.009663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:16.010342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.010646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.010928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.011374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a85bcc-f50e-4eb9-b3d3-a06de456a87b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:16.011679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:16.011987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:16.014899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:16.018870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:16.031491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 110/241] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:16.036866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:16.080914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:16.082295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.082765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.083222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.084098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:16.085694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:16.168412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacaf1e-5939-4002-912b-417abffc360e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:16.186112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 132/242] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:15 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:16.220147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581867-64ac-40e9-a499-16f113941388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:16.221030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581867-64ac-40e9-a499-16f113941388 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.221313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581867-64ac-40e9-a499-16f113941388 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.221585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581867-64ac-40e9-a499-16f113941388 None admin] PATH_INFO: `/v3/users/a96e6c76845c4699982a70407c0a9dd8` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.241726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581867-64ac-40e9-a499-16f113941388 None admin] RBAC: Authorizing `identity:get_user(user_id=a96e6c76845c4699982a70407c0a9dd8)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:16.243391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581867-64ac-40e9-a499-16f113941388 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:16.245288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 111/243] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:16 2022] GET /identity/v3/users/a96e6c76845c4699982a70407c0a9dd8 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:16.251662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:16.298666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:16.329566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa3d2-ba85-4f03-b4be-18a5d70fef54 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.330676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa3d2-ba85-4f03-b4be-18a5d70fef54 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.331203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa3d2-ba85-4f03-b4be-18a5d70fef54 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.334413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 112/244] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:16.340325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3ca8-2184-489e-8e8b-af7f330ddaa7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.340974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3ca8-2184-489e-8e8b-af7f330ddaa7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.341451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3ca8-2184-489e-8e8b-af7f330ddaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.379404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-4dac3ca8-2184-489e-8e8b-af7f330ddaa7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:16.384355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4dac3ca8-2184-489e-8e8b-af7f330ddaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:16.387896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f89cdb-3ab6-4b27-b9ce-f09c4b560284 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:16.425731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:16.426314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.426624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.426925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.449468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:16.477816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 113/245] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:16.479474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25a18-7de5-4e0c-9541-1133a306f9a8 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.479953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25a18-7de5-4e0c-9541-1133a306f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.480371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25a18-7de5-4e0c-9541-1133a306f9a8 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.481798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 114/246] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:16.488297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.488755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.489165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.507756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:16.509166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:16.522313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:16.523881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:16.563709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:16.593929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 115/247] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:16.598607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:16.666492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 133/248] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:16.667384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:16.723851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a34b9-97b7-4204-9f4f-3ff6e40dd590 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:16.738942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:16.764051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:16.766107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.767143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.767743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.783997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:16.791618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e971d3-c85f-424d-ac0b-55558703040a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:16.803102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:16.804041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:16.804840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 116/249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:16.805488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:16.849137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:16.859196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:16.860051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:16.862726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:16.862726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:16.882229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:16.889981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:16.891462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:16.892254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:16.903490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 134/250] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:16.904385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.001872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b6f0-24bf-4e1b-a78d-453c5e19b769 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.043061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.044203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.044634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.045054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.045175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9710db-e75b-48b1-8cbe-6ef4bf0e1fef None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.046709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.048436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.050624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 117/251] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:16 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.051607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.080385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.081042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.081515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.081935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.082847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:17.083293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.084812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c112-cbff-489a-a0d4-91b4ef61f875 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.096438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 135/252] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.097984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e26b0e-e17e-46e4-ac66-e18116b225c5 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.098486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e26b0e-e17e-46e4-ac66-e18116b225c5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.098920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e26b0e-e17e-46e4-ac66-e18116b225c5 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.100610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 136/253] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:17.101638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e26b0e-e17e-46e4-ac66-e18116b225c5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.107626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:17.154105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:17.167966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588354b-e39d-4e33-a6b6-ca0930c046b8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.205746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.206799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.207150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.207498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.208321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:17.208715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.209883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e26b0e-e17e-46e4-ac66-e18116b225c5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.210428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.225995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 118/254] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.225995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.250966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.252003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.252484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.253031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.254056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] RBAC: Adding query filter params (role.id=c91119ce2e8d46d78127043f274263e9, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=a96e6c76845c4699982a70407c0a9dd8) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:17.254563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.256459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fee9a-6919-4a08-b367-064c52917bb1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.263157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 137/255] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/role_assignments?user.id=a96e6c76845c4699982a70407c0a9dd8&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=c91119ce2e8d46d78127043f274263e9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.264662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.265200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.266207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.284731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:17.286304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:17.363735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 138/256] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:17.365193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.415909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:17.420946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5260-cb9a-451e-b50c-a420301c26fc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.428011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:17.484068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b09f7-e6dd-46b6-b7e0-e39568056c4f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.523141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.524405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.524877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.525379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] PATH_INFO: `/v3/users/0e7dd52f8284444c8214cc42ff133b9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.526799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] RBAC: Authorizing `identity:get_user(user_id=0e7dd52f8284444c8214cc42ff133b9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.528440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.530249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 139/257] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/users/0e7dd52f8284444c8214cc42ff133b9a => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.531362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.531483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.532255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.532562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.532824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] PATH_INFO: `/v3/users/14660d8429f14493ac39717d5e628687` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.534069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] RBAC: Authorizing `identity:get_user(user_id=14660d8429f14493ac39717d5e628687)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.535549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.537228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 119/258] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/users/14660d8429f14493ac39717d5e628687 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.537943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.640954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e188-7326-41c8-8868-eee850ccd7bc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.653001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:17.687946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.689118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.689737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.691064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.711069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebb039-3bd9-496a-b0b0-1b8b5dccb72e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.715331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:17.731648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:17.732554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:17.733775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 140/259] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:17.735011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.753605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.754506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.754821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.755098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.756544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:17.758043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:17.759887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 120/260] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:17.760675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:17.843017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:17.897490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911caf46-e711-4932-9070-7da36cfc736b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:17.937746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:17.938686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:17.939657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:17.940113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:17.976751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec78688-88be-4707-866f-68632a5588b1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:18.012484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:18.013380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:18.013808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:18.014222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:18.015310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:18.015825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.017338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.026094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 121/261] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:18.027104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:18.033558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:18.110722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.112129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.132980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669890-dcea-4f04-a2da-93cf472b5872 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:18.134779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:18.168463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:18.169619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:18.170073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:18.170511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/0e7dd52f8284444c8214cc42ff133b9a/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:18.173403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=750d4f09b0cd427fabbdc2703cc34e9a, user_id=0e7dd52f8284444c8214cc42ff133b9a, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.175105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.249075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 122/262] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:18 2022] PUT /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/0e7dd52f8284444c8214cc42ff133b9a/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:18.250160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:18.278770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 141/263] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:18.290888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:18.427672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3429dd-d315-4fb0-bf60-7caf02a7bbb4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:18.432308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:18.473506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:18.474736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:18.475202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:18.476366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] PATH_INFO: `/v3/users/14660d8429f14493ac39717d5e628687` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:18.477820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] RBAC: Authorizing `identity:get_user(user_id=14660d8429f14493ac39717d5e628687)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.479756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.481630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 123/264] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:18 2022] GET /identity/v3/users/14660d8429f14493ac39717d5e628687 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:18.487804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:18.493105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac5e91-4e65-4f00-8a33-8503df741d12 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:18.549288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:18.567575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:18.568740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:18.569196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:18.569644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:18.571217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.574119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.580668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 142/265] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:18 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:18.604416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:18.685806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab97733-8920-4f83-bf0a-325a34bd63cc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:18.732152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:18.733168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:18.733679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:18.734282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:18.780354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3a9c-49af-4143-a3f5-f724f7fc244d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:18.816598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.819171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.849744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:18.850504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:18.850877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:18.851225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:18.852241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=14660d8429f14493ac39717d5e628687) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:18.852641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:18.854289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:18.855754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:18.872837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 143/266] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:18 2022] GET /identity/v3/role_assignments?user.id=14660d8429f14493ac39717d5e628687&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:18.957764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 124/267] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:18.963621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:18.967835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:19.128076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c939-b37c-4780-a703-478addff15bd None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:19.165120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff204a5-9ebc-431f-8e8d-3286cf49abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:19.165996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff204a5-9ebc-431f-8e8d-3286cf49abf1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.166279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff204a5-9ebc-431f-8e8d-3286cf49abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.166554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff204a5-9ebc-431f-8e8d-3286cf49abf1 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.167799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff204a5-9ebc-431f-8e8d-3286cf49abf1 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:19.169262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff204a5-9ebc-431f-8e8d-3286cf49abf1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:19.171972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 144/268] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:18 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:19.179822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:19.297576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6bcb-e65c-40df-b09b-c2c225eef3b6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:19.329033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:19.335070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:19.336061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.336347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.336629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.337470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] RBAC: Adding query filter params (role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=14660d8429f14493ac39717d5e628687) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:19.337782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:19.339348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b543e51-c732-469b-a306-133c9c6bc935 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:19.345948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 125/269] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:19 2022] GET /identity/v3/role_assignments?user.id=14660d8429f14493ac39717d5e628687&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:19.362239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e059df-b75d-4256-acc6-43fa206882cf None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.362542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e059df-b75d-4256-acc6-43fa206882cf None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.362836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e059df-b75d-4256-acc6-43fa206882cf None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.364494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 145/270] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:19.370307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.370609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.370918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.394509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:19.395760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:19.417083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000dde7-de03-4e05-aea4-ecc9f41ac72d None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.417404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000dde7-de03-4e05-aea4-ecc9f41ac72d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.417642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000dde7-de03-4e05-aea4-ecc9f41ac72d None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.419096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 146/271] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:19.428647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.428938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.429202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.455640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:19.456866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:19.544983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 126/272] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:19.584305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:19.584468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:19.591582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 147/273] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:19.622039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:19.702651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a92df-0e08-4120-9559-06762e28eb40 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:19.728739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:19.738195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c27c-9c92-47d4-a3b5-a11cfd9d8dbf None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:19.744315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:19.745644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.746097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.746673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.761105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:19.771579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:19.772500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:19.773279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:19.775953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 127/274] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:19.782399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:19.787384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:19.788244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.788536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.788812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.790021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:19.791519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:19.793471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 148/275] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:19.798709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:19.888875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:19.926050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cece4f-ba9e-4ec3-a76d-de96390bece3 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:19.926887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e6e9-3a4b-4874-ac42-d807f9942e89 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:19.962164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d96fb-2a62-4755-9e37-ee49219d279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:19.962983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d96fb-2a62-4755-9e37-ee49219d279e None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.963402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d96fb-2a62-4755-9e37-ee49219d279e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.963680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d96fb-2a62-4755-9e37-ee49219d279e None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.964427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d96fb-2a62-4755-9e37-ee49219d279e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:19.966146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d96fb-2a62-4755-9e37-ee49219d279e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:19.968973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:19.969754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:19.970147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:19.970463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:19.971349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:19.971757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:19.973269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:19.984866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 128/276] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:19.990956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:20.039866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:20.064311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 149/277] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:19 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:37:20.065907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd684-9e67-4a83-98d7-8e825b1df8b7 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.066357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd684-9e67-4a83-98d7-8e825b1df8b7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.066861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd684-9e67-4a83-98d7-8e825b1df8b7 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.068402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 150/278] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:20.076356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.076978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.077433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.099587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:20.101324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:20.102414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4207a2-3d53-405a-97e3-998452ac3c58 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:20.139944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:20.141326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.141611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.141883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] PATH_INFO: `/v3/users/03aee1abda4549f8ae1a883cbf3d8245` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.157811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=03aee1abda4549f8ae1a883cbf3d8245)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:20.159320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:20.165992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 129/279] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:19 2022] GET /identity/v3/users/03aee1abda4549f8ae1a883cbf3d8245 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:20.167400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:20.198834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 151/280] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:20.221522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:20.284724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:20.299664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a3d56-6b36-4812-8e56-c0fbf2f2c5f1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:20.302378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:20.344318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604f8e9-1d06-49d8-87d1-dcfd4ef328d6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:20.345161 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:20.346153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.347474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.347936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.348994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, user.id=03aee1abda4549f8ae1a883cbf3d8245, scope.system=all) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:20.349456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:20.351195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:20.358217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 130/281] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jun 16 11:37:20 2022] GET /identity/v3/role_assignments?user.id=03aee1abda4549f8ae1a883cbf3d8245&scope.system=all&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:20.387756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:20.388581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.388856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.389124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.405949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:20.414218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:20.415167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:20.415952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:20.417232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 152/282] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:20.423567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:20.545083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f4d88-11ec-4b00-b585-ebaaf75a76fa None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:20.584311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:20.584988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.585272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.585542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.586293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] RBAC: Adding query filter params (name=reader) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:20.586608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:20.588012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:20.596879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 131/283] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:20.602265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:20.708262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43050-fc92-4ffb-803c-61ad2741fb8d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:20.722254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:20.750392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81769609-99e1-497c-a9d9-e6d5997bd2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:20.751298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769609-99e1-497c-a9d9-e6d5997bd2b1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.751581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769609-99e1-497c-a9d9-e6d5997bd2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.751854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769609-99e1-497c-a9d9-e6d5997bd2b1 None admin] PATH_INFO: `/v3/users/a96e6c76845c4699982a70407c0a9dd8` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.753084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81769609-99e1-497c-a9d9-e6d5997bd2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a96e6c76845c4699982a70407c0a9dd8)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:20.754655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81769609-99e1-497c-a9d9-e6d5997bd2b1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:20.756290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 153/284] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:20 2022] GET /identity/v3/users/a96e6c76845c4699982a70407c0a9dd8 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:20.761749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:20.822127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:20.869124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45789f-097d-4c6e-97ec-695fef212ef4 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.869403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45789f-097d-4c6e-97ec-695fef212ef4 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.869679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45789f-097d-4c6e-97ec-695fef212ef4 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.871089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 154/285] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:20.888337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.888851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.889328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.918318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:20.921127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:20.929899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25487b23-a27f-459a-8db0-fd22fe25c44b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:20.986950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:20.988187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:20.988683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:20.989141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:20.990532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:20.992320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:20.994519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 132/286] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:20 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:21.000459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:21.026995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 155/287] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:21.048134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:21.178977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:21.187818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06438785-0598-4d28-906c-e1af34517c78 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:21.203531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1786-d1b4-4011-a1c9-a08cfe0deb09 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:21.227117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:21.236229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:21.237197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:21.237422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:21.237701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/a96e6c76845c4699982a70407c0a9dd8/roles/c91119ce2e8d46d78127043f274263e9` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:21.239764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] RBAC: Authorizing `identity:create_grant(project_id=750d4f09b0cd427fabbdc2703cc34e9a, user_id=a96e6c76845c4699982a70407c0a9dd8, role_id=c91119ce2e8d46d78127043f274263e9)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:21.241212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:21.250249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:21.251270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:21.251552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:21.251826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:21.262978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:21.271606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:21.272477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:21.273698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 156/288] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:21.280209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:21.345864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 133/289] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:20 2022] PUT /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/users/a96e6c76845c4699982a70407c0a9dd8/roles/c91119ce2e8d46d78127043f274263e9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:21.391493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43f2b-741d-44c9-b9af-6ebdca386a57 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:21.428563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:21.429239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:21.429526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:21.429806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:21.430556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:21.430889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:21.432432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:21.441527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 157/290] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:21.447290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:21.613908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4821-dd5f-4e15-961d-e13f94d9fe22 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:21.655580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:21.657018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:21.657305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:21.657593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] PATH_INFO: `/v3/users/0e7dd52f8284444c8214cc42ff133b9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:21.658822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] RBAC: Authorizing `identity:get_user(user_id=0e7dd52f8284444c8214cc42ff133b9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:21.660369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:21.662347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 134/291] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:21 2022] GET /identity/v3/users/0e7dd52f8284444c8214cc42ff133b9a => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:21.667736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:21.714945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:21.781161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396aa23-11e1-4e0c-bf9b-3af0358a9fad None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:21.825362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:21.826019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:21.826304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:21.826598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:21.918094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:21.919583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:21.974434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:22.047928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 158/292] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:22.053425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:22.082146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:22.172300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ef6c-1962-4d4e-be18-d4bbed5cf649 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:22.212477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92975fc1-1780-410d-affd-9adba5dc9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:22.213347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92975fc1-1780-410d-affd-9adba5dc9464 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:22.213635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92975fc1-1780-410d-affd-9adba5dc9464 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:22.213912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92975fc1-1780-410d-affd-9adba5dc9464 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:22.215131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92975fc1-1780-410d-affd-9adba5dc9464 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:22.220133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92975fc1-1780-410d-affd-9adba5dc9464 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:22.222165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 135/293] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:22 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:22.227763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:22.333177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653253-007b-4cb6-85ca-401a854c7144 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:22.368288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:22.368946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:22.369230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:22.369508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:22.370340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=0e7dd52f8284444c8214cc42ff133b9a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:22.370676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:22.372119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4498d39-49b5-4ee9-9fb4-04a198518d91 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:22.373993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:22.379199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 159/294] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:22 2022] GET /identity/v3/role_assignments?user.id=0e7dd52f8284444c8214cc42ff133b9a&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:22.711505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a97c9-3a7a-45e0-9152-6aa9d49570af None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:22.712010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a97c9-3a7a-45e0-9152-6aa9d49570af None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:22.712084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a97c9-3a7a-45e0-9152-6aa9d49570af None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:22.713675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 136/295] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:22.719470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb3f2-e898-4906-8adf-36bdb846b599 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:22.719976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb3f2-e898-4906-8adf-36bdb846b599 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:22.720051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb3f2-e898-4906-8adf-36bdb846b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:22.738337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e0acb3f2-e898-4906-8adf-36bdb846b599 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:22.739574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e0acb3f2-e898-4906-8adf-36bdb846b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:22.810663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 160/296] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:22.836398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a97c9-3a7a-45e0-9152-6aa9d49570af None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:22.943544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e606-4a8f-4f6f-b53d-cf9240899f6e None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:22.943871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e606-4a8f-4f6f-b53d-cf9240899f6e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:22.944125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e606-4a8f-4f6f-b53d-cf9240899f6e None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:22.945890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 161/297] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:22.950996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ffb5f-bb5e-4594-815e-3b1b647bb7ad None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:22.951287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ffb5f-bb5e-4594-815e-3b1b647bb7ad None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:22.951564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ffb5f-bb5e-4594-815e-3b1b647bb7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:22.957404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:22.966172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a97c9-3a7a-45e0-9152-6aa9d49570af None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:22.969266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-271ffb5f-bb5e-4594-815e-3b1b647bb7ad None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:22.970459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-271ffb5f-bb5e-4594-815e-3b1b647bb7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:23.005590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.006770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.007240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.007726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.027119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:23.037936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:23.038948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:23.039748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 137/298] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:23.045059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.058814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 162/299] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:23.074868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c488-a260-462a-9f51-cba5445a08dc None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.075162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c488-a260-462a-9f51-cba5445a08dc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.075450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c488-a260-462a-9f51-cba5445a08dc None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.077097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 163/300] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:23.082490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.082804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.083088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.100123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:23.101737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:23.159058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b586935-d357-4fb2-99ac-b5a0508de6bb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.159910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:23.175088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 164/301] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:23.176114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.203705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.204369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.204897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.204897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.205636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:23.205935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.207427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.220283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 138/302] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:23.220283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.239144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:23.285402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca718ca-67d8-4406-a32b-f06b4308ef9a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.322635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.323754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.324194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.324477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.329750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276608a-7c7d-40a8-8d0f-e34dde1f0864 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.335321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:23.343346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:23.344426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:23.345694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:23.349219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 165/303] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:23.349854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.367993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.369485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.369776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.370051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.371231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.373067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.375249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 139/304] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:23.375989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.406434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:23.461620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8128e81-38c2-4b95-8c73-f1221eef833a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.464371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:23.482915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541802c3-74e6-4f95-a00b-50f619dbb307 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.499017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.499922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.500203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.500478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] PATH_INFO: `/v3/users/c65f8c9cb677472e9f2887164f61cf83` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.514639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] RBAC: Authorizing `identity:get_user(user_id=c65f8c9cb677472e9f2887164f61cf83)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.516833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.523172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 166/305] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/users/c65f8c9cb677472e9f2887164f61cf83 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:23.523304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.523412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.523518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.523518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.523518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.523518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:23.523518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.523518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.536263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 140/306] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:23.536263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.630898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89d472-2702-435f-897d-3897c90764ff None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.638120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:23.639889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d6dd7-71ed-40cd-8597-970a3cd1be5f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.667394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.668058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.668337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.668615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] PATH_INFO: `/v3/groups` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.669292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.670761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.676749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.677398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.677683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.677963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.678830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] RBAC: Adding query filter params (role.id=c91119ce2e8d46d78127043f274263e9, user.id=c65f8c9cb677472e9f2887164f61cf83, scope.system=all) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:23.679144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.680584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.685824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 141/307] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/role_assignments?user.id=c65f8c9cb677472e9f2887164f61cf83&scope.system=all&role.id=c91119ce2e8d46d78127043f274263e9 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:23.686609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.703326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:23.754758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 167/308] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Jun 16 11:37:23 2022] POST /identity/v3/groups => generated 229 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:23.813866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565429f-35a9-42b6-922d-6617ee034830 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:23.857078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239b6a4-c4f4-484b-9cc4-6b6ea22235c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:23.857974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239b6a4-c4f4-484b-9cc4-6b6ea22235c4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:23.858260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239b6a4-c4f4-484b-9cc4-6b6ea22235c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:23.858537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239b6a4-c4f4-484b-9cc4-6b6ea22235c4 None admin] PATH_INFO: `/v3/users/03aee1abda4549f8ae1a883cbf3d8245` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:23.859928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239b6a4-c4f4-484b-9cc4-6b6ea22235c4 None admin] RBAC: Authorizing `identity:get_user(user_id=03aee1abda4549f8ae1a883cbf3d8245)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:23.861389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239b6a4-c4f4-484b-9cc4-6b6ea22235c4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:23.863524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 142/309] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:23 2022] GET /identity/v3/users/03aee1abda4549f8ae1a883cbf3d8245 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:23.869260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:23.984855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a28fe-d954-44d5-824b-165fdd3212bc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:24.021175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3620ea-ec5f-4d58-ade0-8f98ffc8e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:24.022295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3620ea-ec5f-4d58-ade0-8f98ffc8e1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.022753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3620ea-ec5f-4d58-ade0-8f98ffc8e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.023173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3620ea-ec5f-4d58-ade0-8f98ffc8e1b7 None admin] PATH_INFO: `/v3/system/users/03aee1abda4549f8ae1a883cbf3d8245/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.024819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3620ea-ec5f-4d58-ade0-8f98ffc8e1b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=03aee1abda4549f8ae1a883cbf3d8245, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:24.026346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3620ea-ec5f-4d58-ade0-8f98ffc8e1b7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:24.127596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 168/310] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Jun 16 11:37:23 2022] PUT /identity/v3/system/users/03aee1abda4549f8ae1a883cbf3d8245/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:24.158227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1cce-9f77-4879-98c1-bdc3c66e542d None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.158513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1cce-9f77-4879-98c1-bdc3c66e542d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.158847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1cce-9f77-4879-98c1-bdc3c66e542d None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.160265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 143/311] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:24.166133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.166638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.167019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.185265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:24.186736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:24.216491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:24.271561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 169/312] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:24.296144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1cce-9f77-4879-98c1-bdc3c66e542d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:24.379945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:24.402249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1cce-9f77-4879-98c1-bdc3c66e542d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:24.437516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:24.438319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.438623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.438906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.449091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:24.457028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:24.457933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:24.458764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 144/313] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:24.464357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:24.582244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a198a0a-6c8a-430e-a17c-2e56225b87ce None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:24.604799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:24.605464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.605742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.606013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.606836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:24.607144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:24.608525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:24.617807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 170/314] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:24.623067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:24.731773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0460760-eefd-4a1f-8e05-1545b7262a59 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:24.766083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:24.766983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.767264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.767535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] PATH_INFO: `/v3/users/a96e6c76845c4699982a70407c0a9dd8` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.768729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] RBAC: Authorizing `identity:get_user(user_id=a96e6c76845c4699982a70407c0a9dd8)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:24.770150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:24.772165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 145/315] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:24 2022] GET /identity/v3/users/a96e6c76845c4699982a70407c0a9dd8 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:24.779691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:24.805722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:24.889496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe643-a7f5-40a5-9f3c-e7d16b42ed6e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:24.926556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:24.927653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:24.928136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:24.928613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:24.998959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:25.000807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:25.025106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:25.105926 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 171/316] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:25.112527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:25.122736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:25.215772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e751-d875-46c2-895f-8d604778dc16 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:25.249298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d20fcf-4c2d-44ff-b600-26d0e390b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:25.251005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20fcf-4c2d-44ff-b600-26d0e390b50a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:25.251484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20fcf-4c2d-44ff-b600-26d0e390b50a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:25.251951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20fcf-4c2d-44ff-b600-26d0e390b50a None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:25.253309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20fcf-4c2d-44ff-b600-26d0e390b50a None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:25.254952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20fcf-4c2d-44ff-b600-26d0e390b50a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:25.257206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 146/317] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:25 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:25.262844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:25.363971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ddb31-405d-4440-8048-6f6c75e44f4d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:25.389380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:25.402196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:25.403410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:25.403886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:25.404351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:25.405425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] RBAC: Adding query filter params (role.id=c91119ce2e8d46d78127043f274263e9, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a, user.id=a96e6c76845c4699982a70407c0a9dd8) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:25.406485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:25.408158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba57d-0e55-4746-b16d-364887a518c2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:25.414898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 172/318] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:25 2022] GET /identity/v3/role_assignments?user.id=a96e6c76845c4699982a70407c0a9dd8&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=c91119ce2e8d46d78127043f274263e9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:25.920938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f8c6c-2a76-4e6c-afeb-ae1ac94c66d7 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:25.921809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f8c6c-2a76-4e6c-afeb-ae1ac94c66d7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:25.922036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f8c6c-2a76-4e6c-afeb-ae1ac94c66d7 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:25.923543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 147/319] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:25.928543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90ed2-9567-4ee0-8959-488e4d9c0ace None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:25.928963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90ed2-9567-4ee0-8959-488e4d9c0ace None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:25.929150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90ed2-9567-4ee0-8959-488e4d9c0ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:25.946247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-bde90ed2-9567-4ee0-8959-488e4d9c0ace None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:25.947529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bde90ed2-9567-4ee0-8959-488e4d9c0ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:26.016188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 173/320] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:26.023705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc0e99-d664-4b33-8b62-2b0c6fb7974f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.024066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc0e99-d664-4b33-8b62-2b0c6fb7974f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.024410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc0e99-d664-4b33-8b62-2b0c6fb7974f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.025976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 148/321] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:26.031000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.031292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.031573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.037987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc0e99-d664-4b33-8b62-2b0c6fb7974f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.050425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:26.051952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:26.128084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:26.131053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 174/322] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:26.154920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.155096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc0e99-d664-4b33-8b62-2b0c6fb7974f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.202377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.204441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.204740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.205025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.207374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:26.220263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:26.228385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:26.229375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:26.231080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 149/323] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:26.239580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.271449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0f5d-8ead-4fde-9f1b-83ab61ef34e6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.311289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.312384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.312666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.312942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.314131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:26.315626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:26.317569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 175/324] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:26.322535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.351776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb46bf-1569-4058-b4ae-9b13b18cf277 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.389850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.390601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.390917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.391188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.391952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:26.392254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:26.393657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:26.395355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:26.404226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 150/325] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:26.410963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.439192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f474b5-b3d8-43c8-ac7a-6d40d88a97fb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.455581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:26.476302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98dace-d7a8-4f03-aa63-3852e5c300dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.476993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98dace-d7a8-4f03-aa63-3852e5c300dd None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.477276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98dace-d7a8-4f03-aa63-3852e5c300dd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.477555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98dace-d7a8-4f03-aa63-3852e5c300dd None admin] PATH_INFO: `/v3/groups` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.478239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98dace-d7a8-4f03-aa63-3852e5c300dd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:26.479717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98dace-d7a8-4f03-aa63-3852e5c300dd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:26.530159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85c3a-3ac3-43d5-a365-d395fedf1a62 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.563642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed531-e37d-4eb8-8c11-8c580779d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.564501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed531-e37d-4eb8-8c11-8c580779d54c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.564802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed531-e37d-4eb8-8c11-8c580779d54c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.565077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed531-e37d-4eb8-8c11-8c580779d54c None admin] PATH_INFO: `/v3/users/c65f8c9cb677472e9f2887164f61cf83` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.566354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ed531-e37d-4eb8-8c11-8c580779d54c None admin] RBAC: Authorizing `identity:get_user(user_id=c65f8c9cb677472e9f2887164f61cf83)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:26.567804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ed531-e37d-4eb8-8c11-8c580779d54c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:26.569468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 151/326] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:26 2022] GET /identity/v3/users/c65f8c9cb677472e9f2887164f61cf83 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:26.570780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f390f-dd53-4aea-8910-61c3a1b12e49 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.571064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f390f-dd53-4aea-8910-61c3a1b12e49 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.571340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f390f-dd53-4aea-8910-61c3a1b12e49 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.572548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 152/327] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:26.574969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f390f-dd53-4aea-8910-61c3a1b12e49 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.583809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 176/328] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Jun 16 11:37:26 2022] POST /identity/v3/groups => generated 226 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:37:26.585417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.586120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.586300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.608731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:26.609979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:26.660626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:26.694219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 177/329] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:26.707512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f390f-dd53-4aea-8910-61c3a1b12e49 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.719809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:26.752856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.753897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.754179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.754867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] PATH_INFO: `/v3/system/users/c65f8c9cb677472e9f2887164f61cf83/roles/c91119ce2e8d46d78127043f274263e9` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.756741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c65f8c9cb677472e9f2887164f61cf83, role_id=c91119ce2e8d46d78127043f274263e9)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:26.758199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:26.824085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 153/330] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Jun 16 11:37:26 2022] PUT /identity/v3/system/users/c65f8c9cb677472e9f2887164f61cf83/roles/c91119ce2e8d46d78127043f274263e9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:37:26.855108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4cec6-c9a6-4208-8f7c-d9b88e735879 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:26.860081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:26.912931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:26.913762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:26.914047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:26.914390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:26.927744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:26.937518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:26.939030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:26.939857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:26.941484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 178/331] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:26.951481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:27.066778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730131e-9e1e-4358-9381-d3bb19633dc3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:27.097515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:27.106702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:27.107480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:27.107771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:27.108050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:27.109400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:27.112888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:27.112888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:27.126517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 154/332] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:27.132435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:27.264508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1daa00-32ec-46a3-bd81-63a43bcd900d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:27.309212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435268b-6d38-4aee-9475-92d50c9d9271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:27.310164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435268b-6d38-4aee-9475-92d50c9d9271 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:27.310394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435268b-6d38-4aee-9475-92d50c9d9271 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:27.310696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435268b-6d38-4aee-9475-92d50c9d9271 None admin] PATH_INFO: `/v3/users/03aee1abda4549f8ae1a883cbf3d8245` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:27.312518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435268b-6d38-4aee-9475-92d50c9d9271 None admin] RBAC: Authorizing `identity:get_user(user_id=03aee1abda4549f8ae1a883cbf3d8245)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:27.313984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435268b-6d38-4aee-9475-92d50c9d9271 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:27.315975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 179/333] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:27 2022] GET /identity/v3/users/03aee1abda4549f8ae1a883cbf3d8245 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:27.321463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:27.429152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1fc98-3e10-4043-b81f-864a7cf7702f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:27.469985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:27.471110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:27.471610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:27.472063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:27.473082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] RBAC: Adding query filter params (role.id=538368c9a6544ee3bb8b62b6e42254bb, user.id=03aee1abda4549f8ae1a883cbf3d8245, scope.system=all) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:27.473569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:27.475239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce28fe8-4532-459a-8462-b44158bcf81d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:27.489227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 155/334] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jun 16 11:37:27 2022] GET /identity/v3/role_assignments?user.id=03aee1abda4549f8ae1a883cbf3d8245&scope.system=all&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:29.128192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537a01b-723f-4a73-8bba-4938f36695b1 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:29.129202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537a01b-723f-4a73-8bba-4938f36695b1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:29.129692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537a01b-723f-4a73-8bba-4938f36695b1 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:29.131547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 180/335] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:29.148155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb41c4c-5da0-462b-9c50-fedb884d7bbf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:29.149022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb41c4c-5da0-462b-9c50-fedb884d7bbf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:29.149517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb41c4c-5da0-462b-9c50-fedb884d7bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:29.172204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ffb41c4c-5da0-462b-9c50-fedb884d7bbf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:29.173712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ffb41c4c-5da0-462b-9c50-fedb884d7bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:29.227627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:29.257896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 156/336] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:29.292672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537a01b-723f-4a73-8bba-4938f36695b1 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:29.329551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:29.416532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537a01b-723f-4a73-8bba-4938f36695b1 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:29.455431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0dd1f-8da4-42d7-8dc8-bba210b95697 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:29.455743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0dd1f-8da4-42d7-8dc8-bba210b95697 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:29.455984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0dd1f-8da4-42d7-8dc8-bba210b95697 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:29.457523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 157/337] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:29.462317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:29.462621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:29.462904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:29.473787 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:29.474610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:29.474906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:29.475182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:29.492990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:29.494217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:29.515467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:29.529370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:29.530268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:29.531680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:29.535196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 181/338] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:29.538265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:29.676074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 158/339] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:29.726301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:29.736107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aec05d-5b44-48e6-b8b8-78a8a105bb89 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:29.771619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:29.772550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:29.772982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:29.773418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:29.774314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:29.774792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:29.776312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:29.791917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 182/340] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:29.797590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:29.806439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:30.029658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e6a2-571a-4ad9-91dd-e699524d5a81 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:30.030173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e7060-f17b-46f9-9faf-e607cdfae5f8 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:30.045409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:30.073426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a7f4-cd00-4a07-b8cc-fb67a5e81be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:30.074237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a7f4-cd00-4a07-b8cc-fb67a5e81be3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.074516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a7f4-cd00-4a07-b8cc-fb67a5e81be3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.074830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a7f4-cd00-4a07-b8cc-fb67a5e81be3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.094648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926a7f4-cd00-4a07-b8cc-fb67a5e81be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:30.103526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6809-cb33-4744-ae8c-a7f2ca5e84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:30.104212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6809-cb33-4744-ae8c-a7f2ca5e84d6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.104495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6809-cb33-4744-ae8c-a7f2ca5e84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.104768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6809-cb33-4744-ae8c-a7f2ca5e84d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8926a7f4-cd00-4a07-b8cc-fb67a5e81be3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:30.108477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:30.109366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:30.110161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:30.117435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 183/341] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:30.123024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c8336-2f9d-4fdb-8428-dae6e1dfab13 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.123310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c8336-2f9d-4fdb-8428-dae6e1dfab13 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.123584 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c8336-2f9d-4fdb-8428-dae6e1dfab13 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.125660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 184/342] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:30.135349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c8336-2f9d-4fdb-8428-dae6e1dfab13 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:30.166420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:30.218811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6809-cb33-4744-ae8c-a7f2ca5e84d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:30.220278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6809-cb33-4744-ae8c-a7f2ca5e84d6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:30.325065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c8336-2f9d-4fdb-8428-dae6e1dfab13 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:30.399044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:30.399834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.400119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.400503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 159/343] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:30.401784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134f55-48c4-409c-9cb7-3aa2ae169d4b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.402071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134f55-48c4-409c-9cb7-3aa2ae169d4b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.402342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134f55-48c4-409c-9cb7-3aa2ae169d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.403891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.404752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:30.405066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:30.406549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:30.423500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 185/344] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:30.424408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:30.432219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a3134f55-48c4-409c-9cb7-3aa2ae169d4b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:30.433429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a3134f55-48c4-409c-9cb7-3aa2ae169d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:30.436751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:30.519513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 160/345] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:30.520984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9695-9c13-4658-a214-ece4263ec367 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.521280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9695-9c13-4658-a214-ece4263ec367 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.521562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9695-9c13-4658-a214-ece4263ec367 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.523110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 161/346] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:30.523748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9695-9c13-4658-a214-ece4263ec367 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:30.529235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:30.552716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb06739-2b4f-41f4-9e8a-c654419bfdbe None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:30.597803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c71296-3308-4b36-89a0-a951658f81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:30.599064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71296-3308-4b36-89a0-a951658f81a9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.599545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71296-3308-4b36-89a0-a951658f81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.600012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71296-3308-4b36-89a0-a951658f81a9 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.601392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c71296-3308-4b36-89a0-a951658f81a9 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:30.603078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c71296-3308-4b36-89a0-a951658f81a9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:30.605128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 186/347] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:30 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:30.606372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.611610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.611999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.630184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:30.631505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:30.661677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9695-9c13-4658-a214-ece4263ec367 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:30.711332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 187/348] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:30.711332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:30.716009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:30.717177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.720460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.720942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.736762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:30.829329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:30.831430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:30.833143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:30.865533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a444-cb78-4a6e-ac56-ddbbea4bf6bc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:30.917422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:30.918220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:30.918502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:30.918827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:30.933229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:30.942774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:30.943702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:30.944505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 188/349] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:30.945168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:30.971794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 162/350] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:30.972873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.023831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.082859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcb0d7-dddd-45d5-b58b-3e1ef48b1b0d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.106882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11d53-63a7-4712-8ae3-6dbbf4667194 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.128975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d6a7-d891-43ce-b24e-d61c63485f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.129821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d6a7-d891-43ce-b24e-d61c63485f69 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.130101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d6a7-d891-43ce-b24e-d61c63485f69 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.130422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d6a7-d891-43ce-b24e-d61c63485f69 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.132848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.137789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d6a7-d891-43ce-b24e-d61c63485f69 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.139309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d6a7-d891-43ce-b24e-d61c63485f69 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.141762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 189/351] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:30 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.143288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506a256-2474-4f22-bc2d-d76ce88767eb None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.143739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506a256-2474-4f22-bc2d-d76ce88767eb None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.144179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506a256-2474-4f22-bc2d-d76ce88767eb None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.145837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 190/352] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:31.151358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506a256-2474-4f22-bc2d-d76ce88767eb None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.157420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.158228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.158511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.158822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.175287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:31.183178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:31.184086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:31.185523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 163/353] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:31.189222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.273949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506a256-2474-4f22-bc2d-d76ce88767eb None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.295856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.300015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573a30-21eb-4c9b-8c83-7f67684e0b77 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.321576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.322303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.323119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.323409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.324216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:31.324467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.325838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.336247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 191/354] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.336905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.348299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3a9a8-7242-4292-ad2e-e614b2454a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.349171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3a9a8-7242-4292-ad2e-e614b2454a93 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.349454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3a9a8-7242-4292-ad2e-e614b2454a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.349727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3a9a8-7242-4292-ad2e-e614b2454a93 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.350946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3a9a8-7242-4292-ad2e-e614b2454a93 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.352390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3a9a8-7242-4292-ad2e-e614b2454a93 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.354256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 164/355] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.360345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.360632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.360946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.382486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:31.383665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:31.416343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.471934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 165/356] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:31.472803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.479228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bea744-202c-484b-b0a5-a1344f303764 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.535790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.536455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.536735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.537011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.537910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=1b6659d44dde4309adb297408b0a6c4c) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:31.538231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.539764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.545818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 192/357] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.547019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.619008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.625117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d69765-c521-4a09-8913-5280aa8ee78c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.671950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.672563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.672871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.673123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.673888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:31.674191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.675613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.685837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 166/358] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.686765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.691329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bd35b-a8fb-40e6-8852-86ee54f9d315 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.725749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.737649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.738531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.739951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.740139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] PATH_INFO: `/v3/users/c65f8c9cb677472e9f2887164f61cf83` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.741410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] RBAC: Authorizing `identity:get_user(user_id=c65f8c9cb677472e9f2887164f61cf83)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.742968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.744639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 193/359] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/users/c65f8c9cb677472e9f2887164f61cf83 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.746022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.826457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dec66-f18c-4539-b7c0-c9aa5a7fbeb2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.875486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58f748-ad20-4f38-8b54-6133d54104e6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:31.879303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f3514-52d9-4ee0-8688-1f4d33f5ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.880182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3514-52d9-4ee0-8688-1f4d33f5ed8a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.880463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3514-52d9-4ee0-8688-1f4d33f5ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.880739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3514-52d9-4ee0-8688-1f4d33f5ed8a None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.881951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3514-52d9-4ee0-8688-1f4d33f5ed8a None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:31.883550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3514-52d9-4ee0-8688-1f4d33f5ed8a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:31.889446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 167/360] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:31.889446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298d75-d63e-4e81-a280-a701dccef98f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.889446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298d75-d63e-4e81-a280-a701dccef98f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.889446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298d75-d63e-4e81-a280-a701dccef98f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.889446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 168/361] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:31.891023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298d75-d63e-4e81-a280-a701dccef98f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:31.923508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:31.924964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:31.925444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:31.925910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:31.928689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:31.945250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:31.956367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:31.957318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:31.958103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:31.959534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 194/362] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:31.960363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.013634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298d75-d63e-4e81-a280-a701dccef98f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.030129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.063719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.064739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.065024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.065299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.094356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eec33f-faa6-41cf-83e7-5a28d40d96d1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.129052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.129702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.129981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.130255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.131341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] RBAC: Adding query filter params (role.id=c91119ce2e8d46d78127043f274263e9, user.id=c65f8c9cb677472e9f2887164f61cf83, scope.system=all) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:32.131661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.133107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a818f2-7631-4889-8d2a-e0631d043070 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:32.145801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 195/363] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/role_assignments?user.id=c65f8c9cb677472e9f2887164f61cf83&scope.system=all&role.id=c91119ce2e8d46d78127043f274263e9 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:32.147194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.147491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.147768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.151076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.152791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:32.165318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:32.166500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:32.189369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.265975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 196/364] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:32.267562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.290320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 169/365] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:32.295324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.323570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.414302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94850a1-fe6a-4afe-9e8a-c34b414c7bcc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.453664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50462d4d-6f0e-4542-bf06-e16f7ca1bbcf None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.458091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.458996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.459457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.459903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.460927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=1b6659d44dde4309adb297408b0a6c4c) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:32.461413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.463068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:32.471360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 197/366] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:32.473128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.488074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.507217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.507912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.508196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.508474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.509575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:32.509575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.511007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:32.525551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 170/367] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:32.526435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.613139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a127-64d2-437f-90cd-0a596e2ea7d0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.617466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.670345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc5109-99cf-45d4-af9b-15f3b1d0c629 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.671982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.673088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.673559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.674048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.678899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.680603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:32.682550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 198/368] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:32.683533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.717416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.718307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.718486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.719718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.731601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:32.743233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:32.744150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:32.744941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:32.745544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 171/369] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:32.746122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.806988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.824430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852f29a-a5b8-4962-88c7-c4ab7febebaa None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.893405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.894064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.894341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.894638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.909061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a704e-757e-4dcc-9ffb-a6c3c5eb912f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:32.952616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:32.963701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:32.964579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:32.969939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:32.969939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:32.969939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.970691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:32.977289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 172/370] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:32.978109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:32.978289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:32.979866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.091604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 199/371] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:33.092463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:33.172864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:33.209061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e43f-da39-47d6-82e6-43ab5ac7dfed None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:33.217558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdfad2-b54e-429f-b676-900ad354e6a8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:33.251150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:33.251729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:33.252008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:33.252280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:33.252449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:33.253106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:33.253499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:33.254964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.260848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 200/372] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:33 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:33.261662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:33.273074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:33.273821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:33.274102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:33.274481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:33.275317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:33.275627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:33.277227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.287933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 173/373] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:33.312680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:33.378311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25fc7-60d3-47f0-9ca8-0badb68136c7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:33.417542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:33.418399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:33.418701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:33.418972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:33.423955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:33.425461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.427783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 201/374] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:33 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:33.432959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:33.441433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:33.471152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9823a3-ee42-4dc1-8907-46957b62962e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:33.514733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:33.516108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:33.516389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:33.516662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:33.588910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:33.624422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60c32f-0661-43f8-876f-124c43a6eef8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:33.635662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:33.637132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.663267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:33.664123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:33.664403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:33.664676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:33.665868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:33.667411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.669250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 202/375] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:33 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:33.679514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:33.810975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:33.813330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 174/376] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:33.820767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:33.874131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987aea3-25b7-44af-8df1-a8137c5efde0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:33.934782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:33.935732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:33.936127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:33.936410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:33.939892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:33.939892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:33.941057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c3549-0ebc-493a-8c0d-8d3c5083e858 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:33.954626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 203/377] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:33 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:33.979274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:34.014082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050e9ad-960e-4ab7-8fba-b49aaea0a244 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:34.032443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e1ff-fe6a-49b0-9785-b36969e22e40 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.032784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e1ff-fe6a-49b0-9785-b36969e22e40 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.033007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e1ff-fe6a-49b0-9785-b36969e22e40 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.034689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 204/378] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:34.040454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.040786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.041004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.070780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:34.072565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:34.089441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:34.091029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.091313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.091589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] PATH_INFO: `/v3/projects/76796d2f47b24128882c958275f16408` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.092904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] RBAC: Authorizing `identity:get_project(project_id=76796d2f47b24128882c958275f16408)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:34.094436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:34.096570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 175/379] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:33 2022] GET /identity/v3/projects/76796d2f47b24128882c958275f16408 => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:34.103310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:34.216763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 205/380] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:34.230303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719955dd-d0b4-4045-8095-e2c4dfd1c953 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:34.248054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:34.270549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:34.271442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.271721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.271994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] PATH_INFO: `/v3/groups/584cadbabdee4d109b2102755ff5ab3e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.278829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] RBAC: Authorizing `identity:get_group(group_id=584cadbabdee4d109b2102755ff5ab3e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:34.281227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:34.283697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 176/381] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:34 2022] GET /identity/v3/groups/584cadbabdee4d109b2102755ff5ab3e => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:34.290532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:34.310614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:34.373102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:34.402006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7182ac-32af-4727-8d2f-082dfaea70f1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:34.420410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7b76-39d6-4dc1-81b0-02340f9942f1 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:34.444957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:34.445882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.446325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.446881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.447981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] RBAC: Adding query filter params (group.id=584cadbabdee4d109b2102755ff5ab3e, role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=76796d2f47b24128882c958275f16408) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:34.448443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:34.450015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:34.457757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 177/382] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:34 2022] GET /identity/v3/role_assignments?group.id=584cadbabdee4d109b2102755ff5ab3e&scope.project.id=76796d2f47b24128882c958275f16408&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:34.485293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:34.486292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.486709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.486991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.508583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:34.518138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:34.519194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:34.520041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:34.524302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 206/383] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:34.532668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:34.646668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:34.677467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809295-cbd4-4eac-be41-dbcfed5a1fa1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:34.733573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:34.734850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.735143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.735421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.736200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:34.736511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:34.737928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:34.750892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 178/384] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:34.756716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:34.913326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331b63-8222-444a-a39a-a50efab282fb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:34.942948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:34.958057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:34.958954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:34.959241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:34.959519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:34.960723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:34.962177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:34.964165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 207/385] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:34 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:34.975695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:35.106795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654d91-273c-44a8-b25b-a4d7f5fc9498 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:35.158884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba69e-7a9c-4e36-bfca-c12633773e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:35.159792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba69e-7a9c-4e36-bfca-c12633773e48 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.160074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba69e-7a9c-4e36-bfca-c12633773e48 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.160349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba69e-7a9c-4e36-bfca-c12633773e48 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.161664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba69e-7a9c-4e36-bfca-c12633773e48 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:35.163147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba69e-7a9c-4e36-bfca-c12633773e48 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:35.165200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 179/386] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:34 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:35.170792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:35.217597 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6487c-36b9-4d33-8af1-8efad774429e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.218460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6487c-36b9-4d33-8af1-8efad774429e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.218720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6487c-36b9-4d33-8af1-8efad774429e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.220093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 180/387] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:35.225319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.225608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.225888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.238955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:35.248970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:35.255199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:35.330609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96159dc-9aca-4315-ae3e-c7fbf6ff404b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:35.341896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 181/388] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:35.370152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:35.383528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:35.384416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.384702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.384985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.390625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6659d44dde4309adb297408b0a6c4c, group_id=0f00f599fb1a447dab5cc42869be5a3d, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:35.390625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:35.462872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 208/389] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jun 16 11:37:35 2022] PUT /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:35.498883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cf627-2ce2-425a-8b95-c4278481f419 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:35.550900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:35.551794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.552088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.552369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.554637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:35.575459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:35.584394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:35.585406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:35.587168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 182/390] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:35.592177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:35.654647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:35.701651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60d83-c0e8-426a-ae19-0c092fa67678 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:35.744875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:35.745486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.745770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.746149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.747100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:35.747222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:35.748582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:35.759742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 209/391] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:35.765120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:35.919514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3546a34-a6fc-472c-a60d-8f65ead92f82 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:35.968806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda2994-4dd0-4368-adca-6908a83d0ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:35.969676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda2994-4dd0-4368-adca-6908a83d0ec9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.969958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda2994-4dd0-4368-adca-6908a83d0ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.970235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda2994-4dd0-4368-adca-6908a83d0ec9 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:35.975281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda2994-4dd0-4368-adca-6908a83d0ec9 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:35.976713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda2994-4dd0-4368-adca-6908a83d0ec9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:35.978664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 183/392] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:35 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:35.984356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:35.998742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d524aa-c9c0-4ca8-b2f6-3c5d5737c65b None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:35.999015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d524aa-c9c0-4ca8-b2f6-3c5d5737c65b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:35.999271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d524aa-c9c0-4ca8-b2f6-3c5d5737c65b None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.000635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 184/393] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:36.015819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.016109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.016394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.047732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:36.048935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:36.104171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e88b0b-783e-4a44-ab11-5fe60489cc71 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:36.138966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:36.144333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:36.157149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 185/394] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:36.168597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:36.169462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.169742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.170014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.171271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:36.172790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:36.174751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 210/395] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:35 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:36.183561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:36.183702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:36.372619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53787-8076-4169-acea-af0fc0574b70 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:36.394533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb5263-42db-49e6-b7d1-0d4ee446e5d6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:36.438262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:36.439168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.439450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.439729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.442080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6659d44dde4309adb297408b0a6c4c, group_id=0f00f599fb1a447dab5cc42869be5a3d, role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:36.444590 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:36.459335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:36.469805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.469805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.469805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.471192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:36.479237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:36.480205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:36.481014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 186/396] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:36.487038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:36.525881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 211/397] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jun 16 11:37:36 2022] PUT /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:36.551037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:36.602389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dac6a-3baf-460e-8e99-b552e8ed2bbf None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:36.640890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:36.641491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.641771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.642045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.642834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] RBAC: Adding query filter params (name=member) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:36.643285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:36.644770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c4d1-4de3-4ba9-95d5-4aed9639ca4d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:36.654300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 187/398] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:36.660636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:36.722379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:36.771991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120784c3-0b61-4cdb-a699-3db27325be7d None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.772332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120784c3-0b61-4cdb-a699-3db27325be7d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.772547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120784c3-0b61-4cdb-a699-3db27325be7d None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.773928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 188/399] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:36.779325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.779591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.779870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.807742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:36.808989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:36.818275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859404-ee14-491a-b98b-9bbb0f9ede94 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:36.875088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:36.875942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:36.876329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:36.876603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:36.877886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:36.879347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:36.881515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 212/400] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:36 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:36.886956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:36.909155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 189/401] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:36.933617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:36.995175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:37.067126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12241e-c6e2-4366-8cd9-3d7759391422 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.104537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39753a9-06af-471a-a254-4f10d60f37d8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.114638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.115775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.116283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.116814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.128961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:37.138167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:37.139087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:37.140402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:37.143225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 190/402] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:37.144469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:37.148682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.244183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.245020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.245305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.245585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.246945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:37.248463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:37.250518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 213/403] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:36 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:37.259830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.263057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd36a-b82c-41fd-8b55-af65bd7ef455 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.267012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:37.302175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.303062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.303350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.303630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.304381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:37.304689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:37.306876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f3c9-e3b1-43c6-9df5-03f3a4b9452a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:37.319144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 191/404] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:37.321529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8178614-fde9-453b-8db9-a27bfa9b3eb2 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.322328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8178614-fde9-453b-8db9-a27bfa9b3eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.322703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8178614-fde9-453b-8db9-a27bfa9b3eb2 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.329236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 192/405] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:37.329236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8178614-fde9-453b-8db9-a27bfa9b3eb2 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.404897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1e8c-596c-4270-bd77-41ba11c90dd5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.441733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.442652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.442945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.443226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.445424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] RBAC: Authorizing `identity:create_grant(project_id=750d4f09b0cd427fabbdc2703cc34e9a, group_id=0f00f599fb1a447dab5cc42869be5a3d, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:37.446994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:37.455933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8178614-fde9-453b-8db9-a27bfa9b3eb2 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.492567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad77c5-63e1-4500-b6ee-162d570d1672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.493435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad77c5-63e1-4500-b6ee-162d570d1672 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.493719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad77c5-63e1-4500-b6ee-162d570d1672 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.493991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad77c5-63e1-4500-b6ee-162d570d1672 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.495241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad77c5-63e1-4500-b6ee-162d570d1672 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:37.496723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad77c5-63e1-4500-b6ee-162d570d1672 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:37.502745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 193/406] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:37 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:37.502745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.502745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.502745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.521336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:37.523667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:37.555199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:37.562738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 214/407] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jun 16 11:37:37 2022] PUT /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:37.562738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.608338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 194/408] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:37.631670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.667774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:37.783677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768fd1e-d286-402c-a983-fb82c370c78e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.804589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6956c-76ec-4c15-a071-703fe80eb5b1 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:37.822666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.824026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.824539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.825015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.826437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:37.828807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:37.830978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 215/409] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:37 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:37.837232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.841958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:37.842408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:37.842738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:37.843618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:37.855462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:37.864332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:37.865242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:37.866034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 195/410] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:37.874451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:37.955026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:38.007786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eace35-f3f6-434d-8b8d-df2bfea3c59f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.019042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:38.023487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e14f-69a0-49d2-9605-04883fffbd00 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.061703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.062554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.062875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.063150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.063910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:38.064215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.065713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c3d29-8daf-4598-9e04-595bc49eb0a0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:38.075035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 196/411] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:38.076446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ece3-f89c-421c-bd4c-78973f41149a None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.076735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ece3-f89c-421c-bd4c-78973f41149a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.077011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ece3-f89c-421c-bd4c-78973f41149a None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.079065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 197/412] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:38.080962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ece3-f89c-421c-bd4c-78973f41149a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:38.099004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c198a38-c2ee-4dc6-a6f8-ba016181c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.099899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c198a38-c2ee-4dc6-a6f8-ba016181c0ec None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.100179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c198a38-c2ee-4dc6-a6f8-ba016181c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.100460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c198a38-c2ee-4dc6-a6f8-ba016181c0ec None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.103005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c198a38-c2ee-4dc6-a6f8-ba016181c0ec None admin] RBAC: Authorizing `identity:create_grant(project_id=750d4f09b0cd427fabbdc2703cc34e9a, group_id=0f00f599fb1a447dab5cc42869be5a3d, role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.104467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c198a38-c2ee-4dc6-a6f8-ba016181c0ec None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:38.172158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:38.189098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 216/413] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jun 16 11:37:37 2022] PUT /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a/groups/0f00f599fb1a447dab5cc42869be5a3d/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:38.189098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.189346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.189600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.202067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ece3-f89c-421c-bd4c-78973f41149a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.225460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:38.227887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:38.274752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.275637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.275918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.276195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] PATH_INFO: `/v3/groups/584cadbabdee4d109b2102755ff5ab3e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.277588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] RBAC: Authorizing `identity:get_group(group_id=584cadbabdee4d109b2102755ff5ab3e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.279136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:38.283045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 198/414] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:38 2022] GET /identity/v3/groups/584cadbabdee4d109b2102755ff5ab3e => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:38.295626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:38.342498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 217/415] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:38.379176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:38.474418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9a63-e865-47a8-8bf9-69791fdefb91 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.508129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c45ae-c90a-4659-a4bd-f0c0e1003591 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.511862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:38.553225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.554029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.554311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.554604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.563596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.564466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.564757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.565190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] PATH_INFO: `/v3/projects/76796d2f47b24128882c958275f16408` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.566659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] RBAC: Authorizing `identity:get_project(project_id=76796d2f47b24128882c958275f16408)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.568119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:38.572260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 199/416] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:38 2022] GET /identity/v3/projects/76796d2f47b24128882c958275f16408 => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:38.576065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:38.577665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:38.585519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:38.587547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:38.588372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:38.588984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 218/417] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:38.595625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:38.636398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:38.698275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49406e2e-7473-44c3-a931-44b08933c37b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.732447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.733112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.733396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.734221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.735063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:38.735291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccaf32-b0a0-47bf-b899-d1894da2c969 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.735392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.736801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:38.745503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 219/418] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:38.751494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:38.774902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.776142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.776629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.777107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] PATH_INFO: `/v3/projects/76796d2f47b24128882c958275f16408/groups/584cadbabdee4d109b2102755ff5ab3e/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.779349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] RBAC: Authorizing `identity:create_grant(project_id=76796d2f47b24128882c958275f16408, group_id=584cadbabdee4d109b2102755ff5ab3e, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.781039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:38.782970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:38.856030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145181f9-e4b2-44b8-b52f-12f5b8c808d7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:38.878513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 200/419] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jun 16 11:37:38 2022] PUT /identity/v3/projects/76796d2f47b24128882c958275f16408/groups/584cadbabdee4d109b2102755ff5ab3e/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:38.894710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b605-8795-4f63-8873-7f4dfb239f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:38.895399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b605-8795-4f63-8873-7f4dfb239f33 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:38.895685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b605-8795-4f63-8873-7f4dfb239f33 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:38.895965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b605-8795-4f63-8873-7f4dfb239f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:38.974851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280b605-8795-4f63-8873-7f4dfb239f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:38.976354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280b605-8795-4f63-8873-7f4dfb239f33 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:39.003029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:39.089412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 220/420] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:39.095066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:39.201553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:39.226383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cab25-c2cb-4853-805a-89be9032cd06 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:39.229643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e09fb-97a5-449c-927e-dd37b34735f6 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.230151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e09fb-97a5-449c-927e-dd37b34735f6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.230662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e09fb-97a5-449c-927e-dd37b34735f6 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.232239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 221/421] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:39.237318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.237602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.237881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.267994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:39.269186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:39.285109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:39.285977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.286306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.286605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.289396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:39.290917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:39.292795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 201/422] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:39 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:39.300102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:39.384796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 222/423] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:39.419640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:39.475914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f36c4-9489-4351-9d75-45119d3359c8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:39.496034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:39.555867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:39.557862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.558719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.559633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.564903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:39.567294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:39.569555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 202/424] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:39 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:39.575389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:39.585100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c65a-848c-4457-ae63-83bd8bc2e00a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:39.599153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:39.633497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:39.634364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.634674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.634948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.646102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:39.656800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:39.657703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:39.658503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:39.659828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 223/425] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:39.666829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:39.790451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb38b5b-1987-47e3-83a9-2dbdfea809c0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:39.864488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:39.866052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.866343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.866640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.867499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=1b6659d44dde4309adb297408b0a6c4c) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:39.867814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:39.869260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:39.874381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529512a-01e2-4e40-a2a5-60064023b323 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:39.886150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:39.893301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 203/426] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:39 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:39.912723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:39.913400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:39.913685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:39.913971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:39.914831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:39.915178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:39.916583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0527c-5203-4a16-a313-d34457b4b7f2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:39.927690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 224/427] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:39.932869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.052169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.070075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd6916-5249-4263-a6cc-27cfd8c98b80 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.070710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd6916-5249-4263-a6cc-27cfd8c98b80 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.071161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd6916-5249-4263-a6cc-27cfd8c98b80 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.075642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaa10f-3c9b-4656-b327-65c8c5635af4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.075758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 225/428] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:40.080031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.080571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.081075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.108880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.109538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.109827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.110114 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.112382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:40.113997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:40.179624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:40.181085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:40.195479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 226/429] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:40.219357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.269100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.289634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 204/430] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:40.294941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.328004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed9459-9097-4177-a31a-e70ac3e285e1 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.329821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.369091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.370226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.370878 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.371366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.382459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:40.392309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:40.393271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 11:37:40.394064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:40.396938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 227/431] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:40.403668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.411607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d6f9-73f9-4d23-8e0f-d658a08e307b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.449784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.450741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.451024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.451325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] PATH_INFO: `/v3/projects/1b6659d44dde4309adb297408b0a6c4c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.453151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] RBAC: Authorizing `identity:get_project(project_id=1b6659d44dde4309adb297408b0a6c4c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:40.454730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:40.456821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 205/432] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/projects/1b6659d44dde4309adb297408b0a6c4c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:40.462237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.517363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163239-5912-45b3-b1b4-583607fe1a3f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.521152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.563166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.564975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.564975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.564975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.565212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:40.565449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:40.568858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:40.579461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 228/433] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:40.581550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683547a-0e07-4bb9-ae19-0eea50e63c1b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.588580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.618996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.626747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.628092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.628550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.628971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.633457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:40.633457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:40.636342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 206/434] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:40.642837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:40.720534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1211c4-bba6-4a23-8309-f3d8413e89d5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.749130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e38183-a368-42bb-ad6b-f2cddb5ebd7e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:40.770002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.770744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.771027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.771315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.772608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.800755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:40.801420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.801708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.801989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.802865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=1b6659d44dde4309adb297408b0a6c4c) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:40.803186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:40.806219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4367ac-84d8-4b69-8692-589dd525e586 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:40.821220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 207/435] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=1b6659d44dde4309adb297408b0a6c4c&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:40.865830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:40.867420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:40.896707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:40.918654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631aa0d-5a6b-4673-8449-ea361159285c None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.919364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631aa0d-5a6b-4673-8449-ea361159285c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.919839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631aa0d-5a6b-4673-8449-ea361159285c None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.925397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 208/436] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:40.928757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:40.929320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:40.929819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:40.953296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:40.954885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:40.987359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 229/437] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:40.990312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.054900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 209/438] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:41.079619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.115499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6f7e-d1ce-49ab-8160-1240a1499de8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.144478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:41.156670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.157543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.160094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.160094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.160094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:41.161457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:41.166627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 230/439] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:40 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:41.169635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.218662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c4857-5609-4f02-86e2-ee832c282a4a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.238036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:41.266051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.266881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.267223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.267478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.279747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:41.288952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:41.289881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:41.290760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:41.293220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 210/440] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:41.297197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.307080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de190-93ce-420a-990c-aa15b27a3e3e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.352563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.353775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.354291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.354800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.356210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:41.357673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:41.360282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 231/441] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:41.367385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.417316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a522-5073-45d2-85e7-fa068ad1ca0f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.428407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:41.453093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.454059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.454544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.455019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.455953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:41.456399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:41.457891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:41.469494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26e54-0db4-441d-9a32-2817311fad0e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.470889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 211/442] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:41.472417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.506956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.507642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.507933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.508213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.509071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=538368c9a6544ee3bb8b62b6e42254bb, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:41.509385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:41.510923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb3b1-0c16-4309-8410-4b0e889a6fc1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:41.512548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:41.528157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 232/443] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=538368c9a6544ee3bb8b62b6e42254bb => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:41.556994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506ed6-0abb-4516-9a25-20fe680dd5d9 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.557423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506ed6-0abb-4516-9a25-20fe680dd5d9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.557571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506ed6-0abb-4516-9a25-20fe680dd5d9 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.559322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 233/444] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:41.565471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.565471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.565755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.584880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:41.586169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:41.591532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9242e36-d3a3-499b-8621-9d9259e697df None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.630034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.630732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.631015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.631291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.667046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 234/445] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:41.690786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.713398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:41.715189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:41.750749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:41.758209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:41.803049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249708-a634-4dbc-917c-edb57b632866 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.837735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 212/446] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:41.843734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.845279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.845784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.846092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.846370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.862499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:41.871224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:41.872293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:37:41.873093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:41.874881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 235/447] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:41.884266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:41.962972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a568e-0814-47f6-b75a-f46203ecaaee None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.987301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187352-5584-495c-a533-9d14b15b7da8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:41.996156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:41.997006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:41.997296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:41.997576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] PATH_INFO: `/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:41.998813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] RBAC: Authorizing `identity:get_project(project_id=750d4f09b0cd427fabbdc2703cc34e9a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.000277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.000764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:42.002031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 213/448] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/projects/750d4f09b0cd427fabbdc2703cc34e9a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:42.007376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:42.009994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:42.020218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.020873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.021150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.021464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.022204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:42.022507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.023901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.032608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 236/449] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:42.038060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:42.104200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877218be-44a8-4899-b4cb-3b5caba4edd6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:42.133269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2eae-0afc-438c-bc29-cd161727c342 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:42.138065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.138939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.139224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.139504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] PATH_INFO: `/v3/groups/0f00f599fb1a447dab5cc42869be5a3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.141249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] RBAC: Authorizing `identity:get_group(group_id=0f00f599fb1a447dab5cc42869be5a3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.142694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.144309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 214/450] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:42 2022] GET /identity/v3/groups/0f00f599fb1a447dab5cc42869be5a3d => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:42.149947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:42.173041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.173690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.173984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.174252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.221703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:42.223137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:42.244405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.245854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.250763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ee5a-a0c2-4a66-b7b3-613416c19fe9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:42.284264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.284910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.285202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.285480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.286304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] RBAC: Adding query filter params (group.id=0f00f599fb1a447dab5cc42869be5a3d, role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:42.286646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.288057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.293789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 215/451] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:42 2022] GET /identity/v3/role_assignments?group.id=0f00f599fb1a447dab5cc42869be5a3d&scope.project.id=750d4f09b0cd427fabbdc2703cc34e9a&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:42.344909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 237/452] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 11:37:42.350659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:42.455293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca9580-86f8-492e-842e-387ec2e6c8fc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:42.494868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.495672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.495954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.496234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] PATH_INFO: `/v3/projects/76796d2f47b24128882c958275f16408` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.497447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] RBAC: Authorizing `identity:get_project(project_id=76796d2f47b24128882c958275f16408)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.498995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.500713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 216/453] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:37:42 2022] GET /identity/v3/projects/76796d2f47b24128882c958275f16408 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:42.506214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:42.586500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:42.609678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd24b4-9abf-4197-86f8-e5923a339b65 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:42.643592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64217bab-7995-4dc9-b037-8fea40fbb3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.644498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64217bab-7995-4dc9-b037-8fea40fbb3fb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.644774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64217bab-7995-4dc9-b037-8fea40fbb3fb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.645049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64217bab-7995-4dc9-b037-8fea40fbb3fb None admin] PATH_INFO: `/v3/groups/584cadbabdee4d109b2102755ff5ab3e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.646227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64217bab-7995-4dc9-b037-8fea40fbb3fb None admin] RBAC: Authorizing `identity:get_group(group_id=584cadbabdee4d109b2102755ff5ab3e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.647707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64217bab-7995-4dc9-b037-8fea40fbb3fb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.649331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 238/454] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jun 16 11:37:42 2022] GET /identity/v3/groups/584cadbabdee4d109b2102755ff5ab3e => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:42.655418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:42.658848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:42.752878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27cdb8-d7b8-4cfe-b67e-be7937cf6364 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:42.784721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:42.785392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:42.785660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:42.785937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:42.786855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] RBAC: Adding query filter params (group.id=584cadbabdee4d109b2102755ff5ab3e, role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=76796d2f47b24128882c958275f16408) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:42.787167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:42.788946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4b5a7-9e25-466f-be85-e403c4934e76 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:42.795353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 217/455] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jun 16 11:37:42 2022] GET /identity/v3/role_assignments?group.id=584cadbabdee4d109b2102755ff5ab3e&scope.project.id=76796d2f47b24128882c958275f16408&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:45.422183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c20b-d2bc-4393-a750-cebc8905281b None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:45.423222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c20b-d2bc-4393-a750-cebc8905281b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:45.423725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c20b-d2bc-4393-a750-cebc8905281b None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:45.425288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 239/456] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:45.430686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cc8b-8239-4e75-ba34-ba1f5738e811 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:45.431539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cc8b-8239-4e75-ba34-ba1f5738e811 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:45.432010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cc8b-8239-4e75-ba34-ba1f5738e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:45.459580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6d48cc8b-8239-4e75-ba34-ba1f5738e811 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:45.461132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6d48cc8b-8239-4e75-ba34-ba1f5738e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:45.538100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:45.549075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 218/457] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:45.585057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2c20b-d2bc-4393-a750-cebc8905281b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:45.605335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78db2c-a10d-4251-b5f3-6765d5345d62 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:45.606071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78db2c-a10d-4251-b5f3-6765d5345d62 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:45.606514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78db2c-a10d-4251-b5f3-6765d5345d62 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:45.608080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 219/458] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:37:45.615238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:45.616263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:45.617525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:45.648027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:45.650252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:45.764389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2c20b-d2bc-4393-a750-cebc8905281b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:45.769946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 220/459] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:45.807361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:45.808367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:45.808496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:45.808775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:45.809048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:45.833745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:45.836935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:45.859405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:45.890464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:45.891456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:45.892309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:45.892309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:45.892309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:45.892309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:45.892309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 240/460] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:45.897786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:45.943434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e382d8e-c0dc-42f3-9e6f-764a8090a9bd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:45.994938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.004753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.005808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.006274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.006784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.018425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.020177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-854a175d-8829-430d-aee3-8822902b0ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:46.039500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:46.040374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:46.041210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:46.041210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:46.041210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:46.041210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:46.048231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 221/461] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:46.048470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb281-4d1f-42bf-b049-a8f8fe28cb6f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.048975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb281-4d1f-42bf-b049-a8f8fe28cb6f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.049295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb281-4d1f-42bf-b049-a8f8fe28cb6f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.050898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 222/462] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:46.051827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cd7fa-0c1d-49a6-9b7c-b2ed546d4405 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.052089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cd7fa-0c1d-49a6-9b7c-b2ed546d4405 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.052360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cd7fa-0c1d-49a6-9b7c-b2ed546d4405 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.053696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 223/463] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:46.058160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cd7fa-0c1d-49a6-9b7c-b2ed546d4405 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.058575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993d064-9f19-4411-aea9-44c0abb0f9c7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.093084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.093903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.094490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.094817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.095686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:46.095994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.097361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eec67-5547-4ff0-a97d-691c62d742a6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.121406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 241/464] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:46.122762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc229e3-9849-44c4-9fb8-c8a215b5931e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.123058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc229e3-9849-44c4-9fb8-c8a215b5931e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.123350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc229e3-9849-44c4-9fb8-c8a215b5931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.139963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2bc229e3-9849-44c4-9fb8-c8a215b5931e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:46.141144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2bc229e3-9849-44c4-9fb8-c8a215b5931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:46.172670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cd7fa-0c1d-49a6-9b7c-b2ed546d4405 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.191321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.207658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 242/465] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:46.208907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.209195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.209472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.222904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.223757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.224208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.224629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.225501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:46.225967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.227792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.235388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:46.236587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:46.243341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 224/466] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:46.244587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.286973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.306739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 243/467] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:46.308298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.356999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceade142-1983-4cd1-8521-43fd11ea6b69 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.394122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.394797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.395134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.395381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.396052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.397741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.417760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5671-13da-43c8-871c-e48ae56c4c6f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.434766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.452365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.453166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.453454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.453729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.463611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.465074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:46.482856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:46.484482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:46.485528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:46.485528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:46.485528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:46.485528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:46.485528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 244/468] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:46.485940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.512597 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 225/469] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:46 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:46.512597 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.613380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32596c80-591f-435b-85b6-132b538de7c0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.619674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.627169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2753e-d8bd-4621-b0d9-a4fad98e9cac None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.669249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.670032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.670234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.670658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.670755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.671578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.671676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.671856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.672593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.674089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.686564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.689422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:46.708649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:46.710426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:46.711494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:46.711494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:46.711494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:46.711494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:46.718317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 226/470] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:46.718317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.766527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 245/471] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:46 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:46.767399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.801454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.838816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677549e9-2bec-4621-a52e-8db78841b6ed None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.899195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.900166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.900451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.901239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.902306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:46.902635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.904757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340f12e-66ce-4b9c-a77d-d5503b2773ee None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.908089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ff005-1372-448a-ac93-caa44b3b4a0f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:46.922475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 227/472] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:46.924602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac466cd-14fd-4970-9a14-4775ae9b2963 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.925169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac466cd-14fd-4970-9a14-4775ae9b2963 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.925450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac466cd-14fd-4970-9a14-4775ae9b2963 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.927840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 228/473] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:46.928635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac466cd-14fd-4970-9a14-4775ae9b2963 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:46.940530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:46.949545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:46.955985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.955985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.955985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.955985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:46.955985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:46.955985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f708b8-9a09-4efb-8081-193d287539d4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:46.968767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 246/474] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:46.970091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:46.970415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:46.974623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:46.989479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:46.990780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:47.071849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac466cd-14fd-4970-9a14-4775ae9b2963 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:47.072416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 247/475] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:47.072968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:47.088663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:47.128776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:47.130098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:47.130641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:47.131251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:47.132782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:47.134974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:47.178442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e750f-5a2e-463c-be04-f06ad3293bdc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:47.215161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:47.215882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:47.216167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:47.216442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:47.217191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:47.218688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:47.261397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 229/476] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:46 2022] POST /identity/v3/users => generated 248 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:47.265557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:47.336936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:47.354047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 248/477] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:47 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:47.398536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada1d61-c0c5-4704-9d05-714511bd50ae None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:47.438390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:47.439437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:47.439881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:47.440317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:47.441236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:47.442886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:47.489634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.sql.core [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 11:37:47.489634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 11:37:47.489634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [parameters: {'id': '36e978b2c0624653b26be659709ec584', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 11:37:47.489634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91906) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application conn.query(q) Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application result.read() Jun 16 11:37:47.507244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 11:37:47.508355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application next(self.gen) Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application yield resource Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application next(self.gen) Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise self.value Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application session.commit() Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 11:37:47.509504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self.session.flush() Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application compat.raise_( Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 11:37:47.510647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 11:37:47.511807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application conn.query(q) Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application result.read() Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 11:37:47.513199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [parameters: {'id': '36e978b2c0624653b26be659709ec584', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:47.514120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 11:37:47.515621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:47.518318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 230/478] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jun 16 11:37:47 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:47.525043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:47.604606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:47.642169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178448-96d9-4d73-a0b1-c9d54f8dff6d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:47.711709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c35bf-b375-4913-ba53-4f67ca4ec236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:47.712444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c35bf-b375-4913-ba53-4f67ca4ec236 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:47.712726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c35bf-b375-4913-ba53-4f67ca4ec236 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:47.713002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c35bf-b375-4913-ba53-4f67ca4ec236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:47.727728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c35bf-b375-4913-ba53-4f67ca4ec236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-318c35bf-b375-4913-ba53-4f67ca4ec236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:47.736434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:47.737313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 11:37:47.738091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:47.740125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 249/479] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:37:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:47.745745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:47.864148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21163-886b-4645-9a91-07959aa8090f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:47.903469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:47.911001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:47.911713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:47.912004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:47.912302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:47.913062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:47.913370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:47.914773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca78e5-8ac0-4d56-bdf9-9c27fac672eb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:47.931039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 231/480] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:48.981626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5cdf2-6ba0-4472-a3cb-e9ff090b0184 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:48.982130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5cdf2-6ba0-4472-a3cb-e9ff090b0184 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:48.982242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5cdf2-6ba0-4472-a3cb-e9ff090b0184 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:48.983924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 250/481] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:48.988780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951684e2-e9f2-4070-a64a-f1e8ba26a2f3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:48.989182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951684e2-e9f2-4070-a64a-f1e8ba26a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:48.989362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951684e2-e9f2-4070-a64a-f1e8ba26a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.011106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-951684e2-e9f2-4070-a64a-f1e8ba26a2f3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:49.012561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-951684e2-e9f2-4070-a64a-f1e8ba26a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:49.104993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 232/482] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:49.145267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5cdf2-6ba0-4472-a3cb-e9ff090b0184 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:49.221576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677917d-115e-4be3-a619-7dee9c8e6fd1 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:49.221864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677917d-115e-4be3-a619-7dee9c8e6fd1 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:49.222132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677917d-115e-4be3-a619-7dee9c8e6fd1 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.223786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 233/483] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:49.234630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:49.234924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:49.235204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.255539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:49.256732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:49.300415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5cdf2-6ba0-4472-a3cb-e9ff090b0184 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:49.343326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 234/484] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:49.354821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:49.355727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:49.356112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:49.356495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.357368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:49.368422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:49.373948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:49.388315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:49.389215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:49.390080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:49.398976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 251/485] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:49.400424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:49.505255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:49.517004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974e67-e18f-4401-ac91-14c2eec3a23d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:49.571607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:49.572268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:49.572547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:49.572817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.573564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:49.573864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:49.575276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:49.593444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 252/486] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:49.598999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:49.614897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82ef56-ca63-4e5e-b069-1b0318f0a09d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:49.734254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:49.735011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:49.735299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:49.735577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.746728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:49.754508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:49.756303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:49.757362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:49.758362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:49.760649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 235/487] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:49.766899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:49.841489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c1bd-9d3e-45a4-9c4b-ed1b6a87b591 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:49.905090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:49.906162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:49.906604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:49.907016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:49.930619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:49.930619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:49.946150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:49.947294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:49.948320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:49.948320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:49.948320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:49.948320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:49.948320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 253/488] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:49.953546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:49.959698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6c46-a995-4b53-8f95-38d9ea1fd096 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:49.981492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.016174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.016927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.017148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.017423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.018162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:50.018465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.020158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f5e83-e045-4bd4-a2d2-9dedb1b4638f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.029323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 236/489] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:50.030746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934362-405d-4f55-99a9-e454678d9f1e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.031101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934362-405d-4f55-99a9-e454678d9f1e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.031444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934362-405d-4f55-99a9-e454678d9f1e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.036749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 237/490] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:50.037576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934362-405d-4f55-99a9-e454678d9f1e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.096367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cc831-0b30-46a5-ba15-39f675067835 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.099369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.138943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.140670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.140670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.140670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.146611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:50.146611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.146611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f118-30dd-4cda-986b-df86bd24fbfe None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.158607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934362-405d-4f55-99a9-e454678d9f1e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.166619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 254/491] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:50.166619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.166619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.166619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.186608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:50.186836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:50.195348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.196746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.197033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.197305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.212988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.214704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:50.239549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:50.240842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:50.242535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:50.242535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:50.242535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:50.242535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:50.242535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 238/492] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:50.242535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.269186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 255/493] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:50.270164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.278200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.360096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8c178-1808-4db9-b8d6-ec8675431e90 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.369814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.376270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023d8a-209d-4cda-8a38-62ee7baf60d2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.394384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.395368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.395654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.395928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.404391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.406613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.412617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.413272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.413549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.413819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.414536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:50.414867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.416231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-88c24a8f-ea35-44cd-ae3a-7c1b7a961bfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:50.422562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:50.423464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:37:50.424360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:50.426015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 239/494] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:50.428044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff5e60-accd-4206-9603-e51d4dc6129e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.428803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff5e60-accd-4206-9603-e51d4dc6129e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.429091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff5e60-accd-4206-9603-e51d4dc6129e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.430510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 240/495] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:50.431111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff5e60-accd-4206-9603-e51d4dc6129e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.434365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 256/496] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:50.434365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.536184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.547239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011c909-cf86-47ec-9804-c2e2ed3c284f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.555680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff5e60-accd-4206-9603-e51d4dc6129e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.581744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36505215-8d30-4471-a309-295e82e883fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.582723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36505215-8d30-4471-a309-295e82e883fb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.583316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36505215-8d30-4471-a309-295e82e883fb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.583630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36505215-8d30-4471-a309-295e82e883fb None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.584468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36505215-8d30-4471-a309-295e82e883fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:50.584782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36505215-8d30-4471-a309-295e82e883fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.586200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36505215-8d30-4471-a309-295e82e883fb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.592415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418755-727e-4341-9752-b41544c3622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.593741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418755-727e-4341-9752-b41544c3622f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.594026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418755-727e-4341-9752-b41544c3622f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.594302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418755-727e-4341-9752-b41544c3622f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.605098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45418755-727e-4341-9752-b41544c3622f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-45418755-727e-4341-9752-b41544c3622f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:50.612883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:50.614536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:50.615377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 241/497] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:50.616061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.616061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.616691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.633172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 257/498] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:50.633172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36505215-8d30-4471-a309-295e82e883fb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.637673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:50.638918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:50.647452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.710519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 242/499] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:50.715612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.740743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36505215-8d30-4471-a309-295e82e883fb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.775495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.776314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.776577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.776850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.784363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.785814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.792786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:50.801468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:50.803306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 258/500] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:50.804195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.824294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c2b1a-07e1-430a-bbb3-711ac79e8015 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.858165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.858893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.859176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.859450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.860196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:50.860501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:50.861875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:50.870162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 243/501] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:50.870979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:50.876622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:50.907512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcbfb6-3e67-49fd-89f7-64ce48592a0c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:50.941961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:50.942628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:50.942916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:50.943192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:50.971020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311d18-448d-4bbf-a304-8ffd7e2f4fe7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.004493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748db4-f6cd-4e3d-8699-0f4a53cb80ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.005276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748db4-f6cd-4e3d-8699-0f4a53cb80ae None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.005556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748db4-f6cd-4e3d-8699-0f4a53cb80ae None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.005830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748db4-f6cd-4e3d-8699-0f4a53cb80ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.007665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.008309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.009758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.017833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3748db4-f6cd-4e3d-8699-0f4a53cb80ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-c3748db4-f6cd-4e3d-8699-0f4a53cb80ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:51.025659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:51.026571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:51.027578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 244/502] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:51.028241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404bdef-22c8-46b6-ba41-7c0a05ba3b0c None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.028494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404bdef-22c8-46b6-ba41-7c0a05ba3b0c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.028705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404bdef-22c8-46b6-ba41-7c0a05ba3b0c None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.030088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 245/503] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:51.030729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404bdef-22c8-46b6-ba41-7c0a05ba3b0c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.086983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.115564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 259/504] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:51.116511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.135984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404bdef-22c8-46b6-ba41-7c0a05ba3b0c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.168728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.169380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.169660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.169933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.170826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:51.171114 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.172543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.208721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 246/505] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:51.209526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.209905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668fe6b-cb33-4f99-b8ce-705e97f3f584 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.244887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.245671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.245955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.246235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.256560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.257994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.260727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-08f7f9f0-5dde-48f1-bb51-fc9fb833eca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:51.275506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:51.276350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:51.277305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:51.277305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:51.277305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.277305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:51.277305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 260/506] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:51.277864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.278115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.278383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.293910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:51.295178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:51.310564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb7b9-7352-4786-81a9-a8e072f7aff8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.313319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.343550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.344137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.344419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.344694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.345425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:51.345735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.347126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.354920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 247/507] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:51.355768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.366072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 261/508] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:51.366918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.454401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf34f8b-04c6-468e-b2cc-71b029a514e7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.467673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.472891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39a5bd-88a0-4d8c-8b6b-b21f8bdde38a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.488684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523692e-0329-453d-908d-9f553730e637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.489473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523692e-0329-453d-908d-9f553730e637 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.489752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523692e-0329-453d-908d-9f553730e637 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.490028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523692e-0329-453d-908d-9f553730e637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.500205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523692e-0329-453d-908d-9f553730e637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.501679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523692e-0329-453d-908d-9f553730e637 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.505656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.506288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.506567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.506883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e523692e-0329-453d-908d-9f553730e637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:51.519333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:51.520359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:51.521451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:51.521451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:51.521451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.521451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:51.527527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 248/509] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:51.527527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523692e-0329-453d-908d-9f553730e637 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.535957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.580795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.582264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.624108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523692e-0329-453d-908d-9f553730e637 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.661900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.662561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.662868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.663147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.663907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:51.664221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.665606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.678445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 249/510] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:51.679272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.684968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 262/511] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:51.684968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.707869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.735258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.778063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa8238-9544-46de-8c6b-c0bf20fa431a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.778573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a00698-8fd3-4ab3-8e4b-51e37b904124 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.810020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.810277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.810851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.811095 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.811188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.811376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.811981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.812790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.821786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.822437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.823282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.823896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:51.840574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:51.841464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:51.842335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:51.842335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:51.842335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.842335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:51.842547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:51.846779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:51.849105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:51.849105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:51.849105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:51.849105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:51.849388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 250/512] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:51.849480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 263/513] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:51.849480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.849624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:51.924453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.945280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578d878-a441-48bf-bcaa-50fa10807952 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.948927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b52b74-e5fa-4884-ab61-4d417a77c60b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:51.956121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:51.978485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.979170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.979453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.979729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.980438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:51.980742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.982089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.982328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:51.983143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:51.983990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:51.984266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:51.991441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:51.992873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:51.993650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 251/514] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:51.994624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:52.007201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:52.008129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:52.009022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 264/515] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:52.009574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.095798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034de555-98af-4938-9eba-f399dae1f32c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.107689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278773a2-a821-434a-9409-6f4e839576f5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.127933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.128716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.128997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.129267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.135939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.140575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.141006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.141258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.141542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.141822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.142144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.142563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:52.142893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.144262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.156457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 265/516] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:52.157242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:52.160005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:52.161180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:52.162149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:52.162149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:52.162149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:52.162149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:52.162149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 252/517] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:52.162841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.186464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.256826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985b5a-ed19-4e61-a8e8-7d1f3c4349ea None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.258798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1110cf-35a3-4094-86bb-101984c70d76 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.291021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.291674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.291784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.291959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.292232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.292441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.292727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.292948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:52.293043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.293252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.294667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.299688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.301107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.305514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 266/518] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:52.306299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:37:52.316761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:52.317638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:52.318495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 253/519] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:52.319007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.370381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.391602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.406353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03c63b-2575-4c93-9da6-e0edf2093099 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.418493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f3d81-f80d-4890-8fa2-30df3cce4571 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.439996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.440657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.440946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.441247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.442081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:52.442396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.443868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.452819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.453601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.453885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.454153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.461176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 267/520] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:52.461784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.466471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.468000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:52.482496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:52.483650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 254/521] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:52.484570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.559997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659830f-2d89-469d-a14e-e588f849e3f0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.580580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456e7af-3e1f-470c-85da-939ef1b6fdd6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.593374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.593867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.594658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.594950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.595231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.595961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:52.596275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.597650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.608910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 268/522] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:52.609724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.614564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.618034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.618714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.619003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.619278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.619982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.621402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.707684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dda9-2b49-44e7-94d3-e238d337870b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.711453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 255/523] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:37:52 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:37:52.712283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.744641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.745869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.746452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.746778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.747608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:52.748104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.750620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.782748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 269/524] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:52.782748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.842569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682746-fbcf-4618-a234-a34da32786fc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.860849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.889740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.890393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.890728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.891468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.899570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bd38f-fa43-439c-9a08-bfa56b03e726 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:52.930833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:52.940667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:52.942721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:52.942721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:52.942721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:52.942958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:52.943239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.944609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:52.962512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 270/525] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:52.967440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:52.968620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:52.970049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.072145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc204d30-983c-4e0d-a822-94e5372c05c9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.075983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 256/526] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:53.079580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.096450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.111491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.118740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.118740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.118740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.119850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.121320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:37:53.136558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:53.137417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:53.138247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 271/527] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:53.138763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.153110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.190615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d53df-5288-4b94-a09c-f0de66344eb6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.226002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.227273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.228178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.228937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.230222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=3ad599a6997f44dbb42472277cba7bc0) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:53.231139 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.232814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.241481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 257/528] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/role_assignments?user.id=3ad599a6997f44dbb42472277cba7bc0&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:53.242569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.246546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfadd-9c61-42d1-97c0-f15834b7645b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.288005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.289278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.289743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.290934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.365799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.381695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8951-2463-4cd9-8071-0ca50db2662a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.389829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.391453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.433017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.435135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.435930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.436215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.436517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.449960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.451862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:53.476191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:53.477247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:53.478284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:53.478284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:53.478284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:53.478284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:53.484579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 258/529] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:53.484579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.529264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 272/530] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:53.530923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.596282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dac7e4-ab9f-4149-87ba-f2d1b75b6cdb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.632824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.633750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.634264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.634719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.635696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:53.636194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.637794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.662869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 259/531] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:53.663169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.663765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.667142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33d40-2bfd-4732-a362-918d632d06d7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.712433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.719529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.720561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.720854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.721135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.721871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:53.722182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.724377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.740888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 273/532] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:53.741808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.773779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27badfb-56ea-4d1e-b4f9-1acd0344ba74 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.812576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.813656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.814044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.814328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.825573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.827783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:53.848460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:53.849378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:53.850224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:53.850224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:53.850224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:53.850224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:53.850224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 260/533] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:53.850971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.872834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088faeb6-a17e-4f37-9986-f1bba9bce7f8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:53.914560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:53.915518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:53.915906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:53.916281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:53.917225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=8dd8663dd0584d859bfb3268355f6a6a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:53.917639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:53.919328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:53.926643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 274/534] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/role_assignments?user.id=8dd8663dd0584d859bfb3268355f6a6a&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:53.927669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:53.938289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.985637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:53.998485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a3ce7-52c5-46ab-b5fb-c3c65012acfa None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.050049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884dc5-6a51-438a-95a2-3718e50737e3 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.066529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.067701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.067701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.068002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.085240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.085590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.104185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.105200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.105684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.106116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.106886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:54.107195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.109158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:37:54.112195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:54.113085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:54.113903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:54.116378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 261/535] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:54.121995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:54.122452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 275/536] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:54.131560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:54.229208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720265b8-6bdb-40da-8ded-c2b308a96910 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.268930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.269596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.269880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.270154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.270975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:54.271288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.272722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.291248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 262/537] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:54.297883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:54.317050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:54.327030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:54.385247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767060a-fa45-43bb-9e9a-b279aabc081a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.442650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.442650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.442650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.442650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.457057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.460127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:37:54.482969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:54.484409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:54.487384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 276/538] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:54.494257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d26e-e1d5-46ac-9182-7cd14e28cc92 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.494920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:54.534147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.535168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.535683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.536164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.537200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=14349e981de34943823081c4470cea88) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:54.537734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.539499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.547044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 263/539] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:54 2022] GET /identity/v3/role_assignments?user.id=14349e981de34943823081c4470cea88&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:54.671917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36054b5-96cd-4c7e-86f0-c3c9bbb05871 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.700529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:54.709315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.709979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.710259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.710533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.711360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:54.711670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.713102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2e092-4e66-4aad-a4f6-98eaf3041646 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.734827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 277/540] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:54.741177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:54.823752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:54.846703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67346b-3e5e-4f18-b14e-31f4fb6bb34e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:54.893236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:54.893997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:54.894281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:54.894610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:54.895412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=9a7608c1ceb64497b74bd532e051aee8) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:54.895721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:54.897137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bfc81-83fd-4887-85d7-7fb3bd9bf94d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:54.903195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 264/541] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:54 2022] GET /identity/v3/role_assignments?user.id=9a7608c1ceb64497b74bd532e051aee8&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:55.041336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4f80-5b6c-41fd-ba96-1886303ba93e None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.041650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4f80-5b6c-41fd-ba96-1886303ba93e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.041896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4f80-5b6c-41fd-ba96-1886303ba93e None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.043363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 278/542] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:55.055960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.055960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.055960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.077623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:55.079261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:55.154868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 265/543] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:55.178002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4f80-5b6c-41fd-ba96-1886303ba93e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:55.292357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4f80-5b6c-41fd-ba96-1886303ba93e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:55.338123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:55.339754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.340241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.340719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.352388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:55.360693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:55.361571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:55.362400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:55.365159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 279/544] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:55.370519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:55.461698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:55.493368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb658a7-71d7-4259-b904-0ecd0d66e522 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:55.537723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:55.538826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.539322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.539873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.540840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:55.541364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:55.542972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c6e37-fbd6-4dca-9047-f76e2f397706 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:55.556805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 266/545] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:55.562395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:55.623060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:55.672415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32649068-ab33-42c0-b4d0-2cf387c9281f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.672749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32649068-ab33-42c0-b4d0-2cf387c9281f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.673104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32649068-ab33-42c0-b4d0-2cf387c9281f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.674388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 267/546] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:55.679588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.679877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.680160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.697524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971f7a3-1e41-45d5-b546-e8e2655e1ef1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:55.720140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:55.721984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:55.748823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:55.749742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:55.750021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:55.750292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:55.767954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:55.769417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:55.803334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:55.805176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:55.805176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:55.805176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:55.805176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:55.807827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 280/547] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:55.814138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:55.847871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 268/548] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:37:55.886615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:55.997562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.001735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.007601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a49e22-2ad5-453b-962f-d340c094103e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.059740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c47d5-f49d-4411-b5b2-1de80a346e6d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.076138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.076799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.077620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.077895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.078647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:56.078960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.080338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.105203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 281/549] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:56.111632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.126016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.126843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.127121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.127390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.148747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:56.161691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:56.162631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:56.163482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:56.164677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 269/550] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:37:56.171321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.266664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d451603-c04f-4fd4-a573-77f373a34b16 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.302484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bc36c-3029-4f26-8a56-c74858812fb3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.338374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.339199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.339480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.339757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] PATH_INFO: `/v3/users/swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.342899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.353346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.356307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.365542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.366213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.366497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.366805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.367561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:56.367868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.369236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:56.383867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:56.384817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:37:56.385761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:56.389019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 270/551] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:56.389510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 282/552] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:56.397696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.397883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.435385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.571980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f20a67-cf28-4425-be4c-c5f1434992a7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.598078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84b6c-2875-49a7-8cf8-c43e4ae0ffea None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.612833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.613657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.613942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.614834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.630898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.633521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.645052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.646013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.646402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.646816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.647797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:56.648216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.649785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:56.656520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:56.657581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:56.658638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:56.658638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:56.658638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:56.658638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:56.658638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 271/553] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:56.663164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.672168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 283/554] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:56.683724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.709491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.777816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.788943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6369ab-9424-44d8-9244-ee01ec486274 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.802632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bea2dc-4bfa-4abe-9fe5-d8a8b37cab34 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:56.831385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.832515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.833067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.833476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.834222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:56.834716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.836668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe845e-d533-48b7-b41c-918af5e3e1e9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.840479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b4f38-304d-4975-96f8-3fb8ae7776f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:56.841227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b4f38-304d-4975-96f8-3fb8ae7776f6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.841614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b4f38-304d-4975-96f8-3fb8ae7776f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.841990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b4f38-304d-4975-96f8-3fb8ae7776f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.853515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 272/555] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:37:56.855306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872de0f-85f1-452a-b1a1-552fba146cae None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:56.855920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872de0f-85f1-452a-b1a1-552fba146cae None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:56.856215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872de0f-85f1-452a-b1a1-552fba146cae None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:56.858126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 273/556] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:56.859115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872de0f-85f1-452a-b1a1-552fba146cae None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:56.916713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b4f38-304d-4975-96f8-3fb8ae7776f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:56.918550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b4f38-304d-4975-96f8-3fb8ae7776f6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:56.970230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:56.974864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872de0f-85f1-452a-b1a1-552fba146cae None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.003703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.012529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.013349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.015396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.015706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.023384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.033924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.034246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 284/557] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:37:57.034246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.034246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.034246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:57.040620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:57.042007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:57.043003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 274/558] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:37:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:57.043607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.055367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:57.057094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:57.134459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 285/559] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:57.135753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.159595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0093f1-52f2-4d0d-8567-eb8b20cf132a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.196221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.197017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.197300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.197572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.209627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.211102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-6d5270a2-b04f-417f-a3de-7ad6955cbdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:57.229315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:57.230289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:57.231557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:57.231557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:57.231557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:57.231557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:57.231557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 275/560] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:57.231844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f713-cc27-49c6-9f03-4b8d54feeacb None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.232121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f713-cc27-49c6-9f03-4b8d54feeacb None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.232393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f713-cc27-49c6-9f03-4b8d54feeacb None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.237463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 276/561] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:57.237463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f713-cc27-49c6-9f03-4b8d54feeacb None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.247333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.249525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b13a5-4ed2-4b4c-9f7e-f1190b9df69c None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.257886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.286439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.287135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.287420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.287698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.288537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:57.288847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.290352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.308905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 286/562] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:57.309727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.350918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f713-cc27-49c6-9f03-4b8d54feeacb None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.388422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b72045-46ee-4c5e-a9d5-6996c0535a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.389226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b72045-46ee-4c5e-a9d5-6996c0535a6c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.389867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b72045-46ee-4c5e-a9d5-6996c0535a6c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.389867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b72045-46ee-4c5e-a9d5-6996c0535a6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.400654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b72045-46ee-4c5e-a9d5-6996c0535a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e0b72045-46ee-4c5e-a9d5-6996c0535a6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:57.408282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:57.409298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:57.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 277/563] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:57.411583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.411583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.411583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.423307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2abd9-1347-426b-9108-82dcdb338ee8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.429587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:57.430962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:57.463532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.464283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.464653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.465070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.465870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:57.466248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.468102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.479717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 287/564] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:57.480418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.501273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.506288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 278/565] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:57.507188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.514115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.595665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312f446-1324-479a-8959-d60dc0b59060 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.618787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0afdd-dcea-4c5b-9c3b-f8ec9560c90c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.630418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.631438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.631726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.632006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.642314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.643824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.651455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.652109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.652387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.652657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.653387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:57.653688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.655069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:57.661107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:57.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:57.663815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:57.663815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:57.663815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:57.663815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:57.663815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 288/566] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:57.663815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.664195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 279/567] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:57.664276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.731092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.751740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.770013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fe48f-5c4d-4462-a23d-e9f8893d40c2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.773869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f280-70fe-44b3-832d-7b212fc4b48c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.803111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c905a-b6a5-4b42-8a5a-741c508890eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.804001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c905a-b6a5-4b42-8a5a-741c508890eb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.804314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c905a-b6a5-4b42-8a5a-741c508890eb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.804590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c905a-b6a5-4b42-8a5a-741c508890eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.807662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.808465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.808999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.809616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.816054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c905a-b6a5-4b42-8a5a-741c508890eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:57.817696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.819186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d18c905a-b6a5-4b42-8a5a-741c508890eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:57.823685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:57.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:57.825652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 280/568] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:57.826352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79431bfb-10da-44e8-8ecc-cffe264435c3 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.826499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79431bfb-10da-44e8-8ecc-cffe264435c3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.826803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79431bfb-10da-44e8-8ecc-cffe264435c3 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.829344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 281/569] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:37:57.830249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79431bfb-10da-44e8-8ecc-cffe264435c3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:37:57.841502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:57.842649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:57.843705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 289/570] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:57.844299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.937652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79431bfb-10da-44e8-8ecc-cffe264435c3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.944247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f08db-25b0-48b0-92c1-b7a26eca7e1c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:57.959884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.971789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.972541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.982091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.982091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.982091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:57.982091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.982091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:57.982845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:57.982845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:57.982845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:57.982845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:57.983416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:57.990668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 282/571] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:57.990873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:57.991619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:57.992362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-9eb119db-fdf5-4084-a4dd-51504186b5d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:58.010928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:58.012140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:58.013040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:58.013040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:58.013040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:58.013040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:58.013040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 290/572] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:58.013373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.013658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.013935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.032598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:37:58.033801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:37:58.095474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2848-c6fb-4ab3-93ab-bd386950151b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.099114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 291/573] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:37:58.099923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.130694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.131348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.131630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.131896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.132633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.132930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.134284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.142227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 283/574] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.143085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.189562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.207517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0a3c-1e13-4f17-b33e-af5591c0d5f0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.223900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.241330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.241927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.242214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.242495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.243080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0406-3a75-409c-822b-8ff6b7972dc2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.243324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.243637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.245081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.257914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 292/575] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.258716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.276813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.277594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.277876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.278149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.284780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.286212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:37:58.301458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:58.302442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:58.303353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 284/576] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:58.303843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.373289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a9b1-ddc5-4e29-9c50-4a3478e66a50 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.408121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.408767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.409048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.409325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.410076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.410376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.411806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.415757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959a62c-38d1-44dc-a680-4d96cbd61a51 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.417988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.424632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 293/577] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.425498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.451923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.452711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.452988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.453257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.462905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:37:58.464438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:37:58.471031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:58.475503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 285/578] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:58.476506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.528223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eaa49-347d-46b4-a038-ba109b3f766f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.562033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.563097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.563384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.563659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.573672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.574394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ccd7-c705-4d46-a4bd-30875fe99a3a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.575240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:58.593246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:58.594304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:58.595541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:58.595541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:58.595541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:58.595541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:58.595541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 294/579] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:58.595541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.614011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.614791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.615138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.615527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.616423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=8cfd6158f5124d7cb71c8a77485ff6f6) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.616986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.618279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.624297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 286/580] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/role_assignments?user.id=8cfd6158f5124d7cb71c8a77485ff6f6&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.625090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.662800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.701395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.712694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6020-d926-45ab-bdff-81a9f55c89a0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.743179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d153c-e47e-45de-b2a8-008ba1d5f691 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.753841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.754517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.754839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.755118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.755911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.756222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.757674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.771137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 295/581] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.771806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.785847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.786568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.787357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.787357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.796501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.797937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:58.813553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:58.814535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:37:58.816106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:58.819393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 287/582] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:58.819988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.887674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c4f83-379f-434a-8b54-291e9752ab4c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.919489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.924662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.925441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.925770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.926064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.926841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.927152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.938363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.938490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14845-b53f-4015-9f05-61bab891a3ff None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:58.938711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 296/583] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.938711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:58.955636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:58.970155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:58.970862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:58.971145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:58.971420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:58.972145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:58.972451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:58.973897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:58.986377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 288/584] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:58.987272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.050738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742f858-94a0-4b14-a4d1-6fdf8359b10a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.086410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.087352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.087696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.087982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/3ad599a6997f44dbb42472277cba7bc0/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.094630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eb1b6-ddbf-4b76-986c-238e4cf26d9c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.103102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=3ad599a6997f44dbb42472277cba7bc0, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.104543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.128443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.129109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.129381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.129653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.130478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:59.130809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.132199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.149423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 289/585] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jun 16 11:37:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:59.150016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.159824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:59.176690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 297/586] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:37:58 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/3ad599a6997f44dbb42472277cba7bc0/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:37:59.177419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.262734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:59.285342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe8a9-4903-4aa8-8297-ab0b73aa322c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.308641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603eff0-56d3-4437-9d7c-71c73fc08465 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.340858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.341883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.342552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.342997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.351937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.353002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.353437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.353863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.356781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.359105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.362804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.364608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:59.381125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:59.382074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:59.383883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:59.383883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:59.383883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:59.383883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:59.383883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 290/587] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:59.383883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:59.384617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:59.385491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 11:37:59.386419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:37:59.390154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 298/588] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:59.391246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.449605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:59.491704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07280fef-5405-4171-be5a-8f72f6e6b489 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.528648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.529468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.529848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.530346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.539016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da497c-ee47-49a9-b38b-b8655402d4b1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.541635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.543241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:37:59.563046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:59.564135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:59.565338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:37:59.565338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:37:59.565338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:37:59.565338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:59.566671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 291/589] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:59.567503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:59.571561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.580242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.581426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.581708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.582485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.582721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:59.583030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.585269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.601506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 299/590] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:59.602356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.693727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96c512-239c-4fce-87d8-05d9cf4f7300 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.708442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:59.730301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc9d1-0fa7-43a1-9b4e-87c0192f761f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.741705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.742791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.743707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.744141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.745469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:59.745936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.748477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.775358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.775571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 292/591] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:59.776355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.776579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.776927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.777365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.778263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:37:59.778793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.781458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.797530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 300/592] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:37:59.798767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.854604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:37:59.903598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81c47-b924-4c84-8fdb-26df43b687de None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.936881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58bf3-2044-467d-9443-cfd058d9fb98 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:37:59.950134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.950982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.951269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.951549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.959500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:37:59.961065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:37:59.977730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:37:59.978723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:37:59.979667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 293/593] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:37:59.980257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:37:59.981874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:37:59.983261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:37:59.984260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:37:59.985718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:37:59.999051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.001201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.012157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:00.025939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:00.026893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:00.027811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:00.027811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:00.027811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:00.027811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:00.028804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 301/594] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:00.030896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.092054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33afe5-8903-4e16-9772-aa12378047cc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.135630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.137068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.137551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.138041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.145047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.149595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.151600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.152022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d9be7-cf05-40fa-803e-aee8dc31f8d0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:00.172699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:00.173588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:00.174467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:00.177943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 294/595] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:00.179697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.199121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.199798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.200378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.200663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.203057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:00.203455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.205576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.233201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 302/596] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:00.234197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.290625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.303366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b96a-ce9b-4fc8-91bf-dc8b158c9dc9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.340967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.341793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.342241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.342961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.343797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:00.344399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.345987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.359083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37843950-095a-45b1-8c19-99ec5ba0d022 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.362962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 295/597] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:00.363849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.407303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.407902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.408187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.408624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.409888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:00.410198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.412403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.428832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 303/598] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:00.429989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.448749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.476202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6abb4-7a10-4057-b6fd-6a8b30b8c3f5 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.513575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.514955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.517086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.517367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.528541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.530116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.540340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:00.550875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:00.555282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:00.556483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:00.556483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:00.556483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:00.556483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:00.557119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 296/599] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:00.557927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.559422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3888a-7a35-45b1-9d87-da4afe5c756f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.602715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.604107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.604543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.605270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.614135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.616221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:00.635202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:00.636300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:00.637334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:00.640349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 304/600] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:00.641354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.674713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a1bd-a60d-494d-a168-3975996fa997 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.713662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.714662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.714943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.715259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/8dd8663dd0584d859bfb3268355f6a6a/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.727845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.732426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=8dd8663dd0584d859bfb3268355f6a6a, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.734146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.758237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a1f5-b49c-44e1-a718-34ae941ecd24 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.798533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:00.799233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:00.799518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:00.799795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:00.800554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:00.800862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:00.802218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:00.818808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 305/601] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:00.818808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.829242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 297/602] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:00 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/8dd8663dd0584d859bfb3268355f6a6a/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:00.835013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:00.907358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:00.967137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37d41-13db-4f29-aa2d-5320e2593265 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:00.967334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea566aae-77fb-4de9-8ea6-c3fc3e76b1ed None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.002897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:01.006617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.008497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.015269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.015269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.015466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.015466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.015466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.015466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.015743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:01.015743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:01.015743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712a108-ba57-4df6-9321-1c9a7c40567a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:01.021356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:01.022995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:01.028467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 306/603] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:01.029806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f442b-c33d-4f52-b715-25277e5d2a09 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.030138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f442b-c33d-4f52-b715-25277e5d2a09 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.030418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f442b-c33d-4f52-b715-25277e5d2a09 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.031937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 307/604] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:01.034882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f442b-c33d-4f52-b715-25277e5d2a09 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-62971417-fffa-4eea-bf96-cc863927652b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:01.038427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:01.039319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:01.040213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 298/605] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:01.041351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.041351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.041517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.060121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:01.062442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:01.150117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f442b-c33d-4f52-b715-25277e5d2a09 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.150967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 299/606] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:01.152078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.202815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:01.208155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.209276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.209768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.210236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/14349e981de34943823081c4470cea88/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.227139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=14349e981de34943823081c4470cea88, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:01.228933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:01.266868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4caae-e8bf-47f0-b666-d333855f68a7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.302639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.303309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.303677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.303960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.304759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:01.305126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:01.306616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:01.328595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 300/607] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:01.328595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.333090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 308/608] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:01 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/14349e981de34943823081c4470cea88/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:01.334245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.427911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:01.470986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:01.475359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8755a-1285-4d8f-8ef5-42567633b742 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.498326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cdb7-d4f9-405d-a012-5a1b06343bd7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.524526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fa65c-99bb-4088-8bd9-79a88e0bb594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.525990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fa65c-99bb-4088-8bd9-79a88e0bb594 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.526619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fa65c-99bb-4088-8bd9-79a88e0bb594 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.527471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fa65c-99bb-4088-8bd9-79a88e0bb594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.537357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66238b66-df97-4955-83b8-affaf169b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.538320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66238b66-df97-4955-83b8-affaf169b5d2 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.539520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66238b66-df97-4955-83b8-affaf169b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.539520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66238b66-df97-4955-83b8-affaf169b5d2 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/9a7608c1ceb64497b74bd532e051aee8/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.542108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fa65c-99bb-4088-8bd9-79a88e0bb594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-0f8fa65c-99bb-4088-8bd9-79a88e0bb594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:01.551306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:01.552306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:01.553572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 301/609] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:01.554697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a328a40-13ad-4d3f-9a69-d6bee4d36192 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.554697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a328a40-13ad-4d3f-9a69-d6bee4d36192 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.554697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a328a40-13ad-4d3f-9a69-d6bee4d36192 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.556093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 302/610] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:01.560289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66238b66-df97-4955-83b8-affaf169b5d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=9a7608c1ceb64497b74bd532e051aee8, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:01.561166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a328a40-13ad-4d3f-9a69-d6bee4d36192 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.562017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66238b66-df97-4955-83b8-affaf169b5d2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:01.628355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 309/611] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:01 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/9a7608c1ceb64497b74bd532e051aee8/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:01.629609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.629897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.630223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.667735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:01.668977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:01.689517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a328a40-13ad-4d3f-9a69-d6bee4d36192 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.729362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.730670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.731260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.731740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.732706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:01.733810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:01.735538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:01.745390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 303/612] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:01.755908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.777514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 310/613] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:01.812638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:01.820032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:01.871236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:01.935396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e221b-a384-44c2-b688-314d097a9d23 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:01.984065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:01.985121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:01.985510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:01.985933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:01.995721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7960f0-fc21-4f18-9d0d-15eda55b1391 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.004220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.007782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:02.035329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:02.036278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:02.039244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:02.039244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:02.039244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:02.039244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:02.039244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 304/614] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:02.044232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.062326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.064005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.064285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.064559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.077065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:02.086099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:02.087076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:02.088122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 311/615] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:02.093146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.183848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:02.209385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570dbf0-390c-4c8e-b4d2-4a380c2b8b74 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.245881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.246555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.247047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.247330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.248051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:02.248355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.249749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.262306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 305/616] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:02.265034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:02.267652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.316714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063f8ac-a951-47c7-aa77-ba9b83f2037c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.385355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.386045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.386329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.386639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.387589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:02.388008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.389476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.392641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fd37f-101f-435c-b5af-7b4143bc026e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.408690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 312/617] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:02.414350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.427967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.428758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.429040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.429315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.431271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:02.437034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.438860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:02.453260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:02.454201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:02.455172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:02.458783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 306/618] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:02.460201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.527932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe86e-a3ac-4352-8aec-ab23fca3b66b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.560043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371893-44b9-4f7b-80ce-5834c0713bf7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.564945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.565742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.566028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.566306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.579248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.583348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.583769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:02.595990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.596650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.596930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.597205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.598111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:02.598418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.599850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:02.610744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:02.611608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:02.612482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:02.612482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:02.612482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:02.612482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:02.613523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 313/619] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:02.614774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.617973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 307/620] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:02.627820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.732894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f77f-596b-478e-8771-635a49caed15 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.752470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:02.771176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.772181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.772670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.773148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.774102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:02.774648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.776376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.790430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 314/621] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:02.796250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.824078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe6e86-72ab-41b5-b3d3-a5839c7ae861 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:02.860840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:02.865270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:02.866067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:02.866346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:02.866642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:02.877633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:02.879443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:02.900872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:02.901802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:02.902713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:02.902713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:02.902713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:02.902713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:02.902713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 308/622] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:02.908736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:02.928108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc28198-39b6-4a1b-b51d-a1269d108411 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.017516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.018312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.018641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.018895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.035879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.037327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.043947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99531b3-f580-406e-86db-1fe510244277 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.058903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:03.065628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:03.066570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:03.067561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:03.076241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 315/623] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:03.082271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.112559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.113334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.113628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.113912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.114665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:03.115078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.116559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.142746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 309/624] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:03.158708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.196142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c636e-4e9a-445d-9dc2-40786d1abd7a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.215160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:03.265006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.265696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.265982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.266254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.267131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:03.267439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.268869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fafa80-e223-4d4c-a00b-3b4a147a0963 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.291219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 316/625] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:03.292661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ae683-7a26-424b-ac53-dce09e83ed2b None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.292900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ae683-7a26-424b-ac53-dce09e83ed2b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.293182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ae683-7a26-424b-ac53-dce09e83ed2b None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.298154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 317/626] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:03.299829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ae683-7a26-424b-ac53-dce09e83ed2b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.345073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb9550-4d83-4fa3-b303-4e211631b7c4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.383054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.383855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.384136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.384412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.392035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.393484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-1b0a4cbc-c21e-4f8b-bce1-86a4087f6343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:03.408882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:03.409815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:03.410751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 310/627] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:03.411741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.412797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.412797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.428354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ae683-7a26-424b-ac53-dce09e83ed2b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.430362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:03.431694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:03.453044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:03.474257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.474936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.475217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.475489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.510987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 311/628] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:03.511923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.530969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:03.557112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.559488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.649914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254be95-c593-4b03-95eb-f2c055781848 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.674145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 318/629] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:03.675267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.688801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.689579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.689869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.690148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.690990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:03.691299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.692919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.706017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 312/630] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:03.707007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.725902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:03.771916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:03.804174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f78d-4c99-47b7-854b-f81dc7c4c50b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.829220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1a6d-0280-46c6-9e3e-985148216c2c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:03.849547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.850468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.850859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.851202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.871514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:03.872535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:03.873417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:03.874343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:03.874800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:03.881413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:03.882666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:03.883734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:03.888260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 319/631] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:03.888260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.897545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:03.899034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:03.917168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:03.918993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:03.920998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:03.920998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:03.920998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:03.920998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:03.924755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 313/632] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:03.924755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:03.991768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.009103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7580-f28c-453f-9196-983f2cc882aa None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.031217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dc8be-6d62-4862-912f-f1884e113c50 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.045387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5fc92-a2f9-4ca1-b41f-088c9b735c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.047072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5fc92-a2f9-4ca1-b41f-088c9b735c03 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.047566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5fc92-a2f9-4ca1-b41f-088c9b735c03 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.048038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5fc92-a2f9-4ca1-b41f-088c9b735c03 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/8cfd6158f5124d7cb71c8a77485ff6f6/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.050670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.064441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5fc92-a2f9-4ca1-b41f-088c9b735c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=8cfd6158f5124d7cb71c8a77485ff6f6, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.065776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.066267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5fc92-a2f9-4ca1-b41f-088c9b735c03 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.066422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.066731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.067010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.067786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:04.068090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.069419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.077424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 314/633] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:04.078190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.134734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 320/634] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:03 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/8cfd6158f5124d7cb71c8a77485ff6f6/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:04.136349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7392-51fc-4d8f-870e-bc92a2c21aef None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.136844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7392-51fc-4d8f-870e-bc92a2c21aef None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.137319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7392-51fc-4d8f-870e-bc92a2c21aef None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.139239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 321/635] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:04.140384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e7392-51fc-4d8f-870e-bc92a2c21aef None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.208310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233840-7bd1-4937-824b-4146d1cb8599 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.250857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.263380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.264706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.265161 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.265801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.266823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:04.267077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e7392-51fc-4d8f-870e-bc92a2c21aef None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.267622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.270544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef447-32dd-466b-9ef0-a985ee34c863 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.290312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 315/636] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:04.291955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67daade-e446-49c7-a689-524d34e5377c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.292236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67daade-e446-49c7-a689-524d34e5377c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.292507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67daade-e446-49c7-a689-524d34e5377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.310579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b67daade-e446-49c7-a689-524d34e5377c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:04.310808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.312093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.312385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.312505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b67daade-e446-49c7-a689-524d34e5377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:04.312660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.329594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.331112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-aec7a8ab-3abb-4fd3-999c-6cc7d2923b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:04.350407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:04.351443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:04.352344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:04.352344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:04.352344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:04.352344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:04.352344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 322/637] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:04.353264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0a55-7c97-4e22-b714-0b6a3ec279a2 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.353548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0a55-7c97-4e22-b714-0b6a3ec279a2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.353823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0a55-7c97-4e22-b714-0b6a3ec279a2 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.355375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 323/638] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:04.356038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0a55-7c97-4e22-b714-0b6a3ec279a2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.394847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 316/639] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:04.394847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67daade-e446-49c7-a689-524d34e5377c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.396674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.466743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0a55-7c97-4e22-b714-0b6a3ec279a2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.502968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.503397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67daade-e446-49c7-a689-524d34e5377c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.503759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.504037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.504310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.511708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.513135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.522072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0d4625d9-2b91-4d57-b0fb-22299e9f139d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:04.530507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:04.531532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:04.532495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:04.533508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 324/640] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:04.534784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.535080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.535359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.542464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.543372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.543830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.544283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.545291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:04.545816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.547569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.553313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:04.554540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:04.565472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 317/641] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:04.566181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.628177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 325/642] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:04.629916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.669827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.680037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25d6b0-f783-45c4-a882-efceb074d8b0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.720301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.721099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.721685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.721957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.733286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:04.740944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:04.741985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 318/643] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:04.743544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.759091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630341ed-54c2-4b59-aa01-abf7193cfa35 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.784580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.795372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.800195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.800195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.800195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.800195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:04.800195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.800195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.812370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 326/644] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:04.813319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.851619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee357e-89b7-4417-ba2e-cdee85ffff5c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.898638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.899434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.899710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.899981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.901674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:04.907659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:04.909081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:04.916178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065773df-b36a-44fe-b57a-04f19ec1df23 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:04.929854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:04.931147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 319/645] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:04.932499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:04.957312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:04.958639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:04.959306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:04.960169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:04.971532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:04.979231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:04.980165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:04.981006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 327/646] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:04.981709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.040205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.043991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c40f-efcc-4bc6-8ebe-bf70fbc36bc8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.078183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.078891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.079171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.079441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.080191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:05.080689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.082069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.094702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 320/647] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:05.094702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.107745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb510a-d1b5-4442-8287-7c0518a54fdc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.145731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.146392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.146705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.146986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.147818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=3ad599a6997f44dbb42472277cba7bc0) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:05.148129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.149550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.156230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 328/648] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:04 2022] GET /identity/v3/role_assignments?user.id=3ad599a6997f44dbb42472277cba7bc0&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:05.156818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.169636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.232775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb339-7dd3-4f6c-913c-931a5da1a5f9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.273933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.274909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.275196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.275573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.276544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:05.276959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.278861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.302032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a83ed-11c9-4738-a0ab-153646d1ac4c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.304411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 321/649] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:05.305569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.331262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.345811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.346481 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.346859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.347114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.347870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:05.348175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.349550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.362698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 329/650] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:05.367959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.442669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9a8b0-587a-4bc8-9b81-27789199bbc4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.459976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.487711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.488589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.488872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.489146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.501241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4dd5-2756-489e-8b2c-c439732b6e18 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.502860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.505384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:05.528070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:05.529016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:05.529906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:05.529906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:05.529906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:05.529906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:05.529906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 322/651] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:05.535081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.548375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.549821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.550316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.551107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.624101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.637502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.640441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.662211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974869a-ca8d-494c-9470-2cb8911e96c9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.706178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.707816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.708320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.708796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.720096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.721807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.724536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:05.745433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:05.746366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:05.747326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:05.747326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:05.747326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:05.747326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:05.747326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 323/652] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:05.747326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.769601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 330/653] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:05.769601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.861355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba2e3f-6342-44d5-ae96-23d99ac0f99f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.891299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:05.906763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.907270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d129-d663-4733-96b4-9d221525b741 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:05.907481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.907688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.907963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.908682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:05.908987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.910678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.930608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 324/654] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:05.932588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:05.952529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:05.953690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:05.953845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:05.954221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:05.955165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:05.955577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:05.957157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:05.974478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 331/655] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:05.974478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.006669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.068136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8ff0-bcc6-4aab-a4b9-e7e46c2cf724 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.095340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aba0e7-fd9e-44cf-aab9-97871655c5e6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.107296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.108262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.108645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.109020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.120854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.122569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.140795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.141817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:06.142157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:06.143268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:06.144361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:06.144361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:06.144361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:06.144361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:06.144779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.145211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.150401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 325/656] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:06.151360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.153971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.156797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:06.175165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:06.176316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 11:38:06.177355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:06.179992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 332/657] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:06.180925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.201673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.284217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.290144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bbca7-13f4-4a97-8e93-a11564b2e2ba None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.293394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b873669-8aa9-42c6-9ab0-ef39b1b643b1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.325446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.326241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.326562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.326816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.329841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.330496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.330808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.331085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.331805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:06.332115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.333487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.334378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.335825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.345890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 333/658] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:06.346931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-eca7ce5a-b9c6-434d-9698-807818b455b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:06.349726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:06.350681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 11:38:06.351816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:06.355311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 326/659] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:06.356565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0004811-c89f-4d91-a245-06e8fa9de6f7 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.356851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0004811-c89f-4d91-a245-06e8fa9de6f7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.357127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0004811-c89f-4d91-a245-06e8fa9de6f7 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.359030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 327/660] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:06.359711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0004811-c89f-4d91-a245-06e8fa9de6f7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.463360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.465039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eee39e-0b36-468c-8d5e-8b570c5057c4 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.473974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0004811-c89f-4d91-a245-06e8fa9de6f7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.500148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.500822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.501107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.501384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.502248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:06.502720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.504032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.510197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.511033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.511320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.511595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.519130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.520578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.522250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 334/661] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:06.522908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.535612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e65de7df-a68e-44f1-b108-32783563d24f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:06.539792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:06.540723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:06.541594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 328/662] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:06.542186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.543020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.543020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.559270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:06.560465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:06.630930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 329/663] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:06.632342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.636191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0731-1bde-433d-91ba-f9536814372d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.672933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.673707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.674108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.674387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.675309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:06.675620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.677238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.698744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 335/664] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:06.699567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.731211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.746263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e682-13ea-4d6f-bebf-10af739f5d70 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.768692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.784238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.784881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.785163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.785434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.803220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ddca-5a61-4e5e-bf09-e841e6cf7ecc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.839282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:06.839943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:06.840228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:06.840513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:06.841300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:06.841614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.843119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.856529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 336/665] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:06.856529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.863827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:06.865624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:06.957749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:06.961830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1d64c-954d-4621-838f-75f4ee0a3ae4 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:06.974672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 330/666] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:06.975381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:06.993768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.002289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.003112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.003401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.003806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.014279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:07.023031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:07.023976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:07.024820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:07.027585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 337/667] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:07.028254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.088688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9aaa4-fed8-433c-aad0-b11c31c3cb82 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.122053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.122735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.123020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.123297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.129673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70859-da1a-4387-bb66-2ee12b58caee None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.164724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.165385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.165667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.165948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.166813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=8dd8663dd0584d859bfb3268355f6a6a) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:07.167127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.168570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.175376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 338/668] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/role_assignments?user.id=8dd8663dd0584d859bfb3268355f6a6a&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:07.179653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.182194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.201749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.203626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.252778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.306990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eea0f-7974-4a66-b95f-eda426dc0c82 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.353012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.354074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 331/669] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:07.354376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.354930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.355048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.355633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.373013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.375154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:07.398513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:07.399539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:07.400447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:07.400447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:07.400447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:07.400447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:07.400447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 339/670] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:07.401652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.462522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.482515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633655b0-0982-4569-83ea-0987f7bd7641 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.518719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.519535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.520056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.520172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.520899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:07.521140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.522625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.522724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b154f53-6c26-43b0-a2dc-516a47897c81 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.525932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.532973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 332/671] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:07.533910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.561240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.562125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.562412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.562725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.573414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.575393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-405bd9c4-e487-426f-9080-f975fa9e5e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:07.596160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:07.597119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:07.598040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:07.598040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:07.598040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:07.598040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:07.602038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 340/672] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:07.603467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7715c-6fe2-4d31-8260-fd59919bb221 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.603702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7715c-6fe2-4d31-8260-fd59919bb221 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.603984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7715c-6fe2-4d31-8260-fd59919bb221 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.605287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 341/673] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:07.605977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7715c-6fe2-4d31-8260-fd59919bb221 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.654382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74ed9-9cdf-4323-bf00-c2f722cbd90d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.691873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.692534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.692818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.693097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.693822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:07.694131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.695533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.710041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 333/674] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:07.710904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.718370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7715c-6fe2-4d31-8260-fd59919bb221 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.720045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.753683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.754473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.754785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.755067 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.766109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.770251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-4ca7d933-5f48-4ef3-a202-1f22be2066fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:07.790397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:07.791487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:07.792406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:07.792406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:07.792406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:07.792406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:07.792406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 342/675] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:07.793078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.793078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.793362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.811815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:07.813267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:07.815351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.816629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9926fbb-4230-48f1-8d79-7ece22a23a90 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.852108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:07.852766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:07.853047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:07.853326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:07.856689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:07.856689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:07.856689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:07.868407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 334/676] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:07.869450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.884948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 343/677] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:07.885722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:07.950066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:07.989614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a12e8-b48e-4129-9a43-add167ee6813 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:07.990666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6151-1019-4df8-8683-b9b5ef1fb92c None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.026238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.026927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.027210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.027483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.028196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.028318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.028513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.029093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.029374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.029644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.029872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.037182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.037689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.038610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.047697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 344/678] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.047697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:08.053087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:08.054224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:08.055163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 335/679] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:08.055649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.157004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacb611-d6bd-4a7f-81ed-57fddb98cdcf None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.162512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9ada4-6edf-4177-b0f5-fae30a840b53 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.191378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.192092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.192220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.192431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.192705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.200601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.210407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.210407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.210798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.210887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.210887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.214485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:08.216742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:08.217604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:08.218471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:08.222088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:08.223397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:08.224226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:08.224859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 345/680] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:08.224859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.227805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 336/681] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:08.228824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.291910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.336961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0026a-bf77-45c8-b8ba-ae2ad589ace3 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.338173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3d10-fedd-4b62-bc63-30aab3952c41 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.372887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.374355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.374663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.374938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.375806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.376119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.377427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.377630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.378232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.378516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.378826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] PATH_INFO: `/v3/users/swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.386049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.387517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.394671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 337/682] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.395419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:08.409602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:08.410619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:08.411595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:08.412149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 346/683] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:08.417506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.448376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.504347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109c00-61ed-49e5-be66-c00fb426d507 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.516898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe0952-01c2-49ed-aad9-8ba4e1c7492f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.533759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.541349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.541994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.542271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.542540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.546246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.546246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.546246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.552017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.552657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.552945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.553225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.553973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.554282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.555703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.557815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 338/684] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.558872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.570161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 347/685] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.571323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.677755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c30bb4-6a98-429c-b966-92561e29c810 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.680661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ffc49-f19b-4257-9139-038815e7f8b5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.684543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.711913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.712743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.713262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.713751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.714611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=14349e981de34943823081c4470cea88) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.714953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.716475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.717656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.718322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.718642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.718917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.719760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.720076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.721508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.723206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 339/686] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/role_assignments?user.id=14349e981de34943823081c4470cea88&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.724242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.753812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 348/687] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.753812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.812679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.858751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18182-ba3e-48e3-875d-92149cd0492c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.896898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65c762-ca80-46cb-a3c5-ed546c9490aa None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:08.905963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.906757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.907104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.907442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.909024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=9a7608c1ceb64497b74bd532e051aee8) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:08.909583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.912445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.919989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 340/688] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/role_assignments?user.id=9a7608c1ceb64497b74bd532e051aee8&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:08.921200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:08.945150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:08.946289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:08.946568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:08.946875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:08.963272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:08.965503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:08.967259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:08.992915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:08.994076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:08.995223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:08.995223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:08.995223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:08.995223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:08.996130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 349/689] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:09.002564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.051936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a1e1-b2fa-47fa-878f-b76e0dab66d4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.108486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.109157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.109443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.109724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.131029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:09.142243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c0e1f-46d0-40ae-ac64-01a21d2413c4 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.188164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.188926 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.189210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.189478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.190200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:09.190502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.191940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.205847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 350/690] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:09.206416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.207976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.212327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.249280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:09.338314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06bf5c-ac3b-4ad5-a8e5-efc34ff634a5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.340091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 341/691] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:09.349535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.408174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.408972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.409256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.409526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.426111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.427597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-df572514-a81a-4d46-8127-15358fc647ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:09.444120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:09.445102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:09.446127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 351/692] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:09.447267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fcd93-cbcf-4b97-a07c-e6c411965c60 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.447267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fcd93-cbcf-4b97-a07c-e6c411965c60 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.447436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fcd93-cbcf-4b97-a07c-e6c411965c60 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.448876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 352/693] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:09.453458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fcd93-cbcf-4b97-a07c-e6c411965c60 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.469551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:09.507141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec8470-a03b-40d9-9b6f-334b25f9ba0c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.543963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.544754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.545036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.545309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.547399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:09.556770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.560114 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.576127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fcd93-cbcf-4b97-a07c-e6c411965c60 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-53dfcde8-8fc3-446d-a32c-e8d73a335deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:09.579571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:09.580457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:09.581327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:09.581327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:09.581327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:09.581327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:09.585513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 342/694] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:09.586861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.587149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.587423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.605901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:09.607314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:09.620958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.622071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.622606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.623323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.625119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:09.625651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.628822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.648750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 353/695] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:09.649677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.687393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 343/696] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:09.695787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.740941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:09.800973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82d86-41f5-402b-9019-3da349d327be None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.830248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac68722-3da5-4333-a9f8-e2faf9d30378 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:09.844974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.845633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.845963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.846250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.846995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:09.847351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.848902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:09.849018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.862374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 354/697] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:09.863310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:09.874902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:09.876228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:09.876728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:09.877206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:09.955723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:09.957566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:09.973449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ff9a7-f26f-41c8-bc00-58f7fe95aded None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.001482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:10.010034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.010875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.011786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.011786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.012163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.013532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:10.029259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:10.030327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:10.031223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:10.035478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 355/698] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:10.036318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.062689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 344/699] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:10.063788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.085850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:10.144012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d34a-97e9-41ba-9375-f6a8c75f70ca None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.169008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8445e8-d063-4291-8a5f-a7a0b265294b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.180161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.181045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.181332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.181609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.189735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.191223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.205973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.206909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:10.207091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:10.208908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:10.211004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:10.211904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.211904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.212146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 356/700] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:10.212271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:10.212398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.214779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.214779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.218041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 345/701] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:10.219009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.275541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:10.312574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:10.331686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861c01-694a-44de-85a8-b23f2a56c731 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.333372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d369-e079-4ecd-baf8-3b671a3ecb4e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.375023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.375840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.376295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.376678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.377574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:10.377990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.379541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.380966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.381936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.382364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.382890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.392456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 346/702] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:10.393347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.394349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.396265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:10.419209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:10.420157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:10.421631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:10.421631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:10.421631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:10.421631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:10.423891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 357/703] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:10.424977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.503571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3663e-83da-4e11-aec5-d04a41249bf1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.542949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.543730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.544172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.544550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.545383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:10.546353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.548031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.550312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5d1b-9820-47fa-af53-61da53b4ec20 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.552738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:10.555374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 347/704] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:10.556372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.560176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:10.587791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.588462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.588745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.589017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.589874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=8cfd6158f5124d7cb71c8a77485ff6f6) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:10.590182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.591784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.600833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 358/705] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/role_assignments?user.id=8cfd6158f5124d7cb71c8a77485ff6f6&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:10.673291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28411e2c-27e2-451a-bc74-87233ff0e94f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.713394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.714091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.714507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.714826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.715595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:10.715910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.717350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.731609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 348/706] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:10.736909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:10.876181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e5390-7d7b-4a1d-9b4a-4e4d8955dce7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:10.929775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:10.930573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:10.930877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:10.931156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:10.939428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:10.940858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:10.955970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:10.956892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:10.957823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 359/707] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:10.963703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:11.039689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:11.081858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203e0f-9280-4441-9e2f-89a6b7e9c4c3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:11.118435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27634886-40d2-476d-9964-30eeae683689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:11.119131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27634886-40d2-476d-9964-30eeae683689 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.119419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27634886-40d2-476d-9964-30eeae683689 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.119699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27634886-40d2-476d-9964-30eeae683689 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.120490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27634886-40d2-476d-9964-30eeae683689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:11.120806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27634886-40d2-476d-9964-30eeae683689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:11.122235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27634886-40d2-476d-9964-30eeae683689 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:11.134821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 349/708] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:11.140741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:11.212534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:11.298443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5b0f-780f-4a33-a387-ff1dfa664700 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:11.343168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:11.346569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.346569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.346569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.346569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=3ad599a6997f44dbb42472277cba7bc0) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:11.346569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:11.346984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a409d3-e1b6-4718-a0d8-5815b453dfa9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:11.357533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 360/709] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:11 2022] GET /identity/v3/role_assignments?user.id=3ad599a6997f44dbb42472277cba7bc0&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:11.509631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8716b1-0d23-40ff-853d-1b219e83be05 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.509808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8716b1-0d23-40ff-853d-1b219e83be05 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.510088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8716b1-0d23-40ff-853d-1b219e83be05 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.511804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 350/710] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:11.515167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d60b-1205-4dee-b3a1-da366ccea8a7 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.515460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d60b-1205-4dee-b3a1-da366ccea8a7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.515739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d60b-1205-4dee-b3a1-da366ccea8a7 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.517364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 361/711] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:11.520151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.520437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.520721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.527316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.527602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.527884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.555018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:11.556267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:11.564125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:11.565328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:11.639250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 362/712] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:38:11.662824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:11.685690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 351/713] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 11:38:11.698974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:11.725643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:11.814950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5bcce-23fb-4180-a409-71c2ec4273cd None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:11.817858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:11.879521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:11.880317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.880600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.880871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.897062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046952-266c-4e3d-9e7c-0012a4410c2e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:11.906274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:11.907772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:11.935798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:11.936798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:11.938519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:11.938519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:11.938519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:11.938519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:11.938519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 363/714] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:11.945824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:11.946860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:11.947674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:11.947959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:11.948233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] PATH_INFO: `/v3/services/network` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:11.948890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:11.950246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:11.974446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:11.976426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:11.978322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 352/715] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:11 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:11.986223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:12.079649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:12.118768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81518-4d47-44d4-bf79-10f47e84afbd None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:12.140513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbeac-9092-467b-a48e-8f6a285bdc44 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:12.146342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:12.179970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:12.180645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:12.180931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:12.181212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:12.181937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:12.182245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:12.183809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:12.187129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:12.187803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:12.188347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:12.188630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:12.189358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] RBAC: Adding query filter params (name=network) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:12.189669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:12.195163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:12.196593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 364/716] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:12.203116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:12.208716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 353/717] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:12.215759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:12.355379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e42c7-1f3d-4004-8e4d-7ae7fa964e71 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:12.390535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841def-a039-4a17-8691-81a2c15f05c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:12.391645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841def-a039-4a17-8691-81a2c15f05c0 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:12.392149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841def-a039-4a17-8691-81a2c15f05c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:12.392629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841def-a039-4a17-8691-81a2c15f05c0 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:12.393536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841def-a039-4a17-8691-81a2c15f05c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:12.395224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841def-a039-4a17-8691-81a2c15f05c0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:12.406056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:12.423231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfda65-8c54-43cd-b93d-217f8515b006 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:12.465221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:12.465897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:12.466180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:12.466457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:12.467195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] RBAC: Adding query filter params (type=network) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:12.467530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:12.468895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be94c-9178-4700-85d7-8081d399ff04 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:12.473974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 354/718] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:12.502941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 365/719] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:38:12 2022] POST /identity/v3/users => generated 254 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:13.203097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0127bb-70a2-46a1-964e-195439471903 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:13.204123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0127bb-70a2-46a1-964e-195439471903 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:13.204633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0127bb-70a2-46a1-964e-195439471903 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:13.206509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 355/720] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:13.211363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc91f2-1ba3-46c7-a791-2cc24d057dc2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:13.212194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc91f2-1ba3-46c7-a791-2cc24d057dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:13.212679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc91f2-1ba3-46c7-a791-2cc24d057dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:13.235583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-facc91f2-1ba3-46c7-a791-2cc24d057dc2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:13.237137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-facc91f2-1ba3-46c7-a791-2cc24d057dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:13.317696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 366/721] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:13.354106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0127bb-70a2-46a1-964e-195439471903 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:13.432051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:13.465184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5f87-19a4-4960-bfc9-91a98112fdfe None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:13.465791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5f87-19a4-4960-bfc9-91a98112fdfe None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:13.466308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5f87-19a4-4960-bfc9-91a98112fdfe None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:13.468149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 367/722] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:13.477078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:13.477631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:13.478116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:13.504298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0127bb-70a2-46a1-964e-195439471903 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:13.511651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:13.513317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:13.584163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:13.585216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:13.585773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:13.586257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:13.587279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:13.592144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:13.625752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 368/723] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:13.648594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:13.676343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 356/724] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:13 2022] POST /identity/v3/services => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:13.739506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:13.812604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d860a6-cd60-4b9e-ac3a-79a5528c9e66 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:13.860284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78bcd8-53bb-4561-afeb-465d66d99a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:13.861442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78bcd8-53bb-4561-afeb-465d66d99a5f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:13.861922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78bcd8-53bb-4561-afeb-465d66d99a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:13.862389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78bcd8-53bb-4561-afeb-465d66d99a5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:13.874681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78bcd8-53bb-4561-afeb-465d66d99a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-df78bcd8-53bb-4561-afeb-465d66d99a5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:13.882634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:13.883568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:13.884884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:13.887769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 369/725] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:13.893763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.007090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf59cbb-4123-4eef-9bec-8e2c8f62a47c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.014992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:14.027060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7accca5-2ef8-407d-8cb9-a83f44a46134 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.027380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7accca5-2ef8-407d-8cb9-a83f44a46134 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.027613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7accca5-2ef8-407d-8cb9-a83f44a46134 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.029244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 370/726] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:14.041078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.041418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.041655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.051362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.052400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.052680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.052952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.053704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:14.054011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:14.056872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:14.066151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 357/727] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:14.067668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:14.074645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.076105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:14.205794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227b76-28f9-4646-9ff8-21ddc2cff279 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.218577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 371/728] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:14.241264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.242054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.242331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.242613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.252966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.253398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:14.254868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:14.273119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:14.274040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:14.274951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:14.274951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:14.274951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:14.274951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:14.274951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 358/729] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:14.280509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.303121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:14.321202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:14.416019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f236f-405f-4a13-aa4f-851c77c3742a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.433212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df08268-9e3a-4030-96b3-6ad9cf1ce745 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.451499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.452181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.452461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.452785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.453834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:14.453963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:14.455566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:14.479788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 359/730] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:14.483528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.497994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.499175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.499666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.500141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.518453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:14.527649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:14.528567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:14.529407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:14.537716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 372/731] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:14.545608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.655897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:14.669507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc400-6e04-421f-9f9b-8109e7f38363 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.671689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:14.684659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a3631-806f-4d77-bf29-718ca28450d0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.705995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.707207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.707681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.708133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.716373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:14.718626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:14.735036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:14.736018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:14.736935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:14.739644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 360/732] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:14.745711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.790936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.791314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.791595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.791872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.792629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:14.792937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:14.794338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:14.806533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 373/733] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:14.814238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:14.909835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdfcb7-af73-428a-a6ec-656a31592105 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:14.976738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:14.977414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:14.977696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:14.977971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:14.978853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:14.979162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:14.980582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.006956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.019452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 361/734] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:15.025306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987ad70-1dd0-43e2-8b96-d107c47dfb6a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.025424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.096351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.097089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.097376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.097654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.119039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.120503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-80e9b778-bcb4-4a04-8e7e-0aa752477c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:15.146859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:15.147812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:15.148747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:15.148747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:15.148747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:15.148747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:15.151524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 374/735] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:15.153891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037a9e-5022-44fa-b4c1-f155c7fb294f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.154408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037a9e-5022-44fa-b4c1-f155c7fb294f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.155197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037a9e-5022-44fa-b4c1-f155c7fb294f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.157338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 375/736] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:15.161914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037a9e-5022-44fa-b4c1-f155c7fb294f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.175990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.181781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470cd70-fc40-4e46-b97a-46dceac41407 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.223839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979c449-206c-4d6e-a2fc-e3f53ad51b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.225564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979c449-206c-4d6e-a2fc-e3f53ad51b2a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.226153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979c449-206c-4d6e-a2fc-e3f53ad51b2a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.226693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979c449-206c-4d6e-a2fc-e3f53ad51b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.284974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037a9e-5022-44fa-b4c1-f155c7fb294f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.302381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.306113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979c449-206c-4d6e-a2fc-e3f53ad51b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.307594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979c449-206c-4d6e-a2fc-e3f53ad51b2a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.322210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.322929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.323196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.323473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.324248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:15.324559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.325926 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea207a-181f-414e-89b0-385e90bff52b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.338105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 376/737] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:15.339573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.339943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.340302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.356976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:15.358801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:15.417169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 362/738] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 11:38:15.418617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e34f-cb03-4388-b3be-5424e3b6ad6a None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.418946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e34f-cb03-4388-b3be-5424e3b6ad6a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.419228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e34f-cb03-4388-b3be-5424e3b6ad6a None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.424990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 363/739] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:15.424990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416e34f-cb03-4388-b3be-5424e3b6ad6a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.431872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.438809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 377/740] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:15.447500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.528481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.535426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416e34f-cb03-4388-b3be-5424e3b6ad6a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.556074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb9fe-518f-4df7-b140-7bef177b1b9a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.575432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.576328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.576612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.577425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.585036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.586487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.593004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.593752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.594089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.594369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-140cbe04-c58a-49e9-81d1-7b3e0824743b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:15.601081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:15.602025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:15.603025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 364/741] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:15.603624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.603691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.604112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.610246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.611414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:15.629888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:15.630817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:15.631704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:15.631704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:15.631704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:15.631704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:15.631704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 378/742] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:15.631984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.649522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:15.650751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:15.693144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.718068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 365/743] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 11:38:15.723956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.749877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54c18a-a30f-4ad6-ae6e-c2dc2360f314 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.786699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.787513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.787787 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.788060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.798376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:15.806174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:15.807325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:15.808155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:15.812831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 379/744] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:15.813698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.819986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.834137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac0865-8ab5-4e53-a659-9b13a9a1c545 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.873249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.874902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.875712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.876437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.877607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:15.878099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.880021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.903174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 366/745] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:15.903814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:15.939917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8bf4-426c-4136-aaa5-fc3ccb83ab58 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:15.953940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:15.975622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:15.976289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:15.976577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:15.976860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:15.977585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:15.977899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:15.979438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:15.992780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 380/746] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:15.993599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.013414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787fa41-bf3d-4f15-9e8b-089e7786a998 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.057679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.058638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.058930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.059237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.060152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.062732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.104807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932d9a-c980-409b-9583-dc9385faa433 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.139630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.140220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.140508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.140789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.141541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:16.141851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.143254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.156276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 381/747] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:16.156276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.156522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 367/748] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:15 2022] POST /identity/v3/services => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:16.156522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.166366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.215035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.286085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78814-5eda-498b-b69d-793427b85eea None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.314111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef71a-9401-4dfe-9fda-28a196b95eba None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.326413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.327278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.327566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.327850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.339608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.341061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.359501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:16.359688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:16.360531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:16.361447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:16.361447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:16.361447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:16.361447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:16.361670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.361670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.361670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.361864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 382/749] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:16.361864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.369161 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.370648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-47e562e5-33b7-4050-a5ba-26550d41907b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:16.388006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:16.388970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:16.389967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:16.390411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 368/750] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:16.392354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e3d5-e79c-4c56-ae23-5dfe8be374f9 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.392779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e3d5-e79c-4c56-ae23-5dfe8be374f9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.392991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e3d5-e79c-4c56-ae23-5dfe8be374f9 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.398241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 369/751] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:16.398241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e3d5-e79c-4c56-ae23-5dfe8be374f9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.458492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.463399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.480292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d258df-d420-45d7-bf0c-b08e9958667e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.499913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e3d5-e79c-4c56-ae23-5dfe8be374f9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.514211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.515037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.515321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.515596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.527903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.529350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.535081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.535853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.536247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.536652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.537383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:16.537693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.539073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8ca6a1d3-2683-40a6-8303-686356f8b8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:16.547905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:16.548974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:16.550075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:16.550075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:16.550075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:16.550075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:16.558405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 370/752] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:16.558567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 383/753] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:16.558686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.558775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.558775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.558775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.574779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:16.575961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:16.649161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 384/754] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:16.650175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.667013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8372-e4b5-4251-8515-64635e25968a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.691009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.702831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.703486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.703777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.704047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.704892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:16.705268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.706710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.723310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 371/755] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:16.723310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.738702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.777157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d18a12-0dba-42fe-8180-47a82e72e0ac None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.814297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.815002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.815284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.815557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.816273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:16.816607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.818066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.829352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc12f2-84ee-4a1d-b700-3c5c73f57487 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.835449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 385/756] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:16.836419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.866619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.867411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.867688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.867956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.874868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.876305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:16.896316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:16.897254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:16.898355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:16.904474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 372/757] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:16.904474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:16.946296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.953505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1f343-b9af-4217-b1fc-ca93300cb6aa None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:16.981286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:16.989408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:16.990604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:16.991036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:16.991479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:16.992276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:16.993940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.004397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e834baa-30d5-4ade-ae86-eef4637df8eb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:17.007322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:17.008421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:17.009487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:17.012277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 386/758] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:17.013200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.043423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.044071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.044355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.044627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.045468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=8cfd6158f5124d7cb71c8a77485ff6f6) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:17.045782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.047251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.052569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 373/759] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:16 2022] GET /identity/v3/role_assignments?user.id=8cfd6158f5124d7cb71c8a77485ff6f6&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:17.053329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.140663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073931b-6618-426c-a66d-5c792a977879 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.179207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.180297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.180742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.181163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.192523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.195165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.208253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339a20-0ded-47cb-bf06-2db7ac606f99 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:17.215606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:17.216661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:17.217871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:17.218543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:17.220729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 387/760] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:17.221709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.262295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.263406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.263772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.264123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.266156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:17.266550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.268799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.290469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 374/761] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:17.290469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.298873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:17.352136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e554084-1fbb-4ac0-b0bb-d067ed957d93 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.395759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.396435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.396965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.397250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.398349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:17.398683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.400071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.407757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 388/762] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:17.409021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.417746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcd8cc-b57c-480b-9277-de59742e7b5c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.456324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.456960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.457247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.457526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.458352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:17.458686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.460208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.483544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 375/763] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:17.484530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.511788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:17.540342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8112d-02a7-48a2-aeab-c4b7b94d0f88 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.564787 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:17.588651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.589939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.590230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.590511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/3ad599a6997f44dbb42472277cba7bc0/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.592876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=3ad599a6997f44dbb42472277cba7bc0, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.593917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e5c38-12e3-4882-ac1c-85c55edef8fa None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.594874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.664651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.665296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.665578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.665854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.666571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:17.666896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.668259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.678276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 376/764] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:17.678276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.694628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 389/765] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:17 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/3ad599a6997f44dbb42472277cba7bc0/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:17.695763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.781547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:17.794606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4955-59e2-4eec-8dc4-47b5cb5b8bf8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.838893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.839910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.840327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff82a2-618e-45d0-a229-e83d250a806e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:17.840604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.841069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.891231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:17.891805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:17.892085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:17.892359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:17.893145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] RBAC: Adding query filter params (interface=public, service_id=1404abdf1e44426b9bcd49c892023a2a, region_id=RegionOne) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:17.893456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.894842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.903471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 390/766] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/endpoints?service_id=1404abdf1e44426b9bcd49c892023a2a&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:17.909247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:17.942073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:17.943565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:17.963147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:18.054618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962188d-35f1-460f-9569-8fe2105fa536 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:18.062376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:18.076779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 377/767] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:18.084261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:18.090420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900388e-247b-492e-8c08-b12644465faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:18.091135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900388e-247b-492e-8c08-b12644465faf None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.091415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900388e-247b-492e-8c08-b12644465faf None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.091690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900388e-247b-492e-8c08-b12644465faf None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.093011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900388e-247b-492e-8c08-b12644465faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:18.094398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900388e-247b-492e-8c08-b12644465faf None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:18.100079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 391/768] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:17 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:18.218428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7689fae-b70d-418b-a24a-68fe7b2e0ee8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:18.269025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:18.270180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.270688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.271140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.283015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:18.284708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:18.303251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:18.304201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:18.305137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:18.305137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:18.305137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:18.305137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:18.307117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 378/769] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:18.315709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900388e-247b-492e-8c08-b12644465faf None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:18.421938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900388e-247b-492e-8c08-b12644465faf None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:18.424452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:18.456380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:18.457038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.457319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.457591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.458305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:18.458623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:18.459996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e3f46-5726-4438-b4ed-97a6bca3c680 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:18.472621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 392/770] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:18.477675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:18.526718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:18.608414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168965c0-e4ce-4f8d-b1ae-22b6f5bddd9a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:18.640204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71d9a-7610-44e2-94d7-8c513f5b9a62 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.640518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71d9a-7610-44e2-94d7-8c513f5b9a62 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.640763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71d9a-7610-44e2-94d7-8c513f5b9a62 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.642374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 393/771] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:18.648560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.648947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.649314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.650305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:18.651143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.651596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.651878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.659606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:18.661049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:18.673844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:18.683098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:18.684425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:18.685270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:18.686738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 379/772] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:18.693767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:18.837101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 394/773] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:18.840388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07f26-c3c3-4ab6-adfa-685e1604fe78 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:18.842264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:18.876357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:18.876943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:18.877221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:18.877489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:18.878324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:18.878662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:18.880255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:18.886223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:18.894864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 380/774] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:18.901397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:19.040716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:19.047487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7132-9d8e-4a7c-bb7e-45a6ea2c59e8 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:19.083165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:19.084289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.084727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.085180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] PATH_INFO: `/v3/services/network` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.085993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:19.087549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:19.100588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:19.101807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:19.102894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:19.105305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 395/775] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:18 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:19.111687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:19.136798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dce8a-bb92-472a-a45d-7ae43e950b7c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:19.214827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57404-7a94-4510-bfba-5500329aac7d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:19.239326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:19.239988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.240274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.240553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.241412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=25a7024445c04ac4bcd168b2e8a5365b) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:19.241708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:19.243176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:19.254160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:19.255082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.255531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.255967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.256827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] RBAC: Adding query filter params (name=network) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:19.256953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 381/776] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:18 2022] GET /identity/v3/role_assignments?user.id=25a7024445c04ac4bcd168b2e8a5365b&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:19.257387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:19.267250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb2e58-8198-4574-a13c-5225ec95b263 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:19.273147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 396/777] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:19.278899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:19.333781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:19.446301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93965e-c9c8-4748-8a3a-07bc5be4f0d1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:19.457462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4692-fb7c-4a10-bb64-3f6994444db0 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.458457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4692-fb7c-4a10-bb64-3f6994444db0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.458984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4692-fb7c-4a10-bb64-3f6994444db0 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.462633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 397/778] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:19.467211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.468124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.468473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.491715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:19.493050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.493502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.493949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.494904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] RBAC: Adding query filter params (type=network) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:19.495380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:19.496923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:19.502912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:19.505204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:19.509728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 382/779] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:19.519537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:19.528079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:19.625925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 398/780] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:19.648578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:19.671932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:19.685880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b3f0c-ae1b-4ea9-a6da-8a3912bbab1f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:19.744262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:19.744845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.745128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.745405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.746204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] RBAC: Adding query filter params (interface=public, service_id=2f5d315244e34b1bbe9168b2dd3c1172, region_id=RegionOne) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:19.746517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:19.747966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:19.758145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 383/781] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:19 2022] GET /identity/v3/endpoints?service_id=2f5d315244e34b1bbe9168b2dd3c1172&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:19.763989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:19.889732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267bfad-c370-4ec3-8a93-6ed3cb4f1a9f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:19.930178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:19.930882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:19.931168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:19.931784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:19.932485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:19.933842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:19.940220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 384/782] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:19 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:19.940515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e8b75-354e-4469-937c-29032bd323d6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:20.026417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:20.027277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.027560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.027834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.048624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:20.056483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:20.057463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:20.058323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 399/783] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:20.066032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:20.105014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:20.227244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4915e-782c-49aa-a2f5-84bbe85c62dd None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:20.267726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:20.268407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.268688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.268962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.269718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:20.270026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:20.271452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dadebc-221d-43e1-9f47-104a304bba83 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:20.281088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 385/784] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:20.287901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:20.319032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:20.432377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82069d-aa43-46eb-a0c2-536b4fbe13a5 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.432894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82069d-aa43-46eb-a0c2-536b4fbe13a5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.433315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82069d-aa43-46eb-a0c2-536b4fbe13a5 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.435084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 386/785] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:20.437881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab500-328e-4315-a72d-2b221b3a2dd0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:20.449813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.450264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.450679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.480675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:20.482116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:20.482981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:20.484335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.484749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.485205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.502039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:20.512639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:20.542241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:20.543191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:20.544089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:20.544089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:20.544089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:20.544089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:20.544089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 400/786] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:20.554543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:20.593450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 387/787] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:20.629123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:20.642248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:20.664564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:20.732148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e4572-53b5-4d5b-b2f4-264a14602f53 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:20.793362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:20.795301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.796458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.797912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.798838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:20.799516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:20.801699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:20.818572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0751-6b5c-416f-b5bb-86afe3e895fb None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:20.828978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 401/788] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:20.835703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:20.865385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:20.866536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:20.867025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:20.867476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:20.886530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:20.897450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:20.898463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:20.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:20.902832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 388/789] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:20.913878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:20.991176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789de76-0e22-40ef-9ec4-201497acae13 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.003018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.015597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.026202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.027045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.027330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.027609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.035364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.036821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.049170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd6657-0df3-4bb0-8861-afbffb743e8f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-dece1707-190a-4a23-bf2d-693842eae593 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:21.058627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:21.059854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 402/790] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f98d-053c-4d0a-a34e-e22a7d0f6eea None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.060805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f98d-053c-4d0a-a34e-e22a7d0f6eea None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.061565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f98d-053c-4d0a-a34e-e22a7d0f6eea None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.061565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 403/791] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:21.063073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1f98d-053c-4d0a-a34e-e22a7d0f6eea None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.098078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.099270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.100028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.100869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.102060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:21.102520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.104943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea7fa8-b717-49b2-855c-e92a283d1fb1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.121696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 389/792] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:21.121696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.121696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.121696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.142718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:21.144647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:21.199105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1f98d-053c-4d0a-a34e-e22a7d0f6eea None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.222836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 390/793] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:21.223641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.243016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.243999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.244963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.245436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.246922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:21.247475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.249379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.273811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 404/794] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:21.278405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.319689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.325133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.379506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480898e-373f-49e5-b0d4-3a71d2372b57 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.387468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cecedb-f158-4d39-92a5-7518efe5c8c3 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.423858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.424754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.425129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.425476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.426201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.427014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.427783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.428297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.428823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.429290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:21.440737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:21.441694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 11:38:21.442516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:21.446781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 405/795] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:21.447372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.448035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.448860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:21.469102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:21.470088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:21.471024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:21.471024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:21.471024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:21.471024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:21.474862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 391/796] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:21.475732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.578774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693f89-d718-47de-933f-6ab5d7a582d5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.585865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.589692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7f42-4488-470b-99ef-d9c2b8935348 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.606477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.625465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.626298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.626895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.627178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.631826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.632719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.633246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.633732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.634681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:21.635192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.636772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.641278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.642967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.646661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 392/797] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:21.647740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:21.672267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:21.673206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:21.674087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:21.674087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:21.674087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:21.674087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:21.674998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 406/798] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:21.675091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.755798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34de9-ec62-4211-9249-2b970e1d2180 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.794545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.795256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.795562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.795840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.796585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:21.796896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.798281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a6366-ab3d-4698-b55c-7abc466dad09 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.815851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 393/799] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:21.815851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba4fac-e189-4c6d-94a9-5b7f1a8db58f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.815851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba4fac-e189-4c6d-94a9-5b7f1a8db58f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.815851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba4fac-e189-4c6d-94a9-5b7f1a8db58f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.818895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 394/800] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:21.820437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba4fac-e189-4c6d-94a9-5b7f1a8db58f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.863896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:21.923618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a1e95-49a9-4d3e-b69b-6d409d23c6d5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.930997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba4fac-e189-4c6d-94a9-5b7f1a8db58f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:21.962381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.963079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.963366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.963645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.964351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:21.964662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.966026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.966321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:21.967012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.967320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.967589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.968302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:21.968603 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:21.970045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ae331-0593-4d88-a44f-2bee7897bf00 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:21.972252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 407/801] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:21.973090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:21.988366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 395/802] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:21.990706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:21.991228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:21.991713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:21.997868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.008741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:22.009931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:22.080768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 396/803] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:22.080961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2fa3-47ab-41f5-8b29-f464accf82c6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.081949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.120419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.122729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.124103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.124394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.124669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.132000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.137473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:22.147888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:22.148887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 408/804] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:38:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:22.150442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.199100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877c930-7aad-40a6-935a-15c1709cb535 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.233462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.234116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.234404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.234699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.235427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.236772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.239561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.259121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae0179-434a-48d4-9115-64bf4d6e6c51 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.291903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.292678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.292956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.293225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.300257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.301682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:22.316242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:22.317140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 409/805] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:22.318298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.339024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 397/806] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:22.340024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.452850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ad9c-bced-4cd0-85ef-2e5b067a5ff2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.472921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.499194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468284-365c-438a-9fce-ef2a9fafb7dc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.501455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.502685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.503048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.503409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.511208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.515568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:22.523300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:22.524242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 410/807] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:22.525628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.540609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.541535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.541846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.542125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.543012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:22.543328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.544791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0ff59-3064-4fe5-b8e4-080de6ac0795 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.564297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 398/808] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:38:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:22.565598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323f02a-94fc-4cb2-a3a9-09674b7b7311 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.565883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323f02a-94fc-4cb2-a3a9-09674b7b7311 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.566157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323f02a-94fc-4cb2-a3a9-09674b7b7311 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.567568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 399/809] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:22.571647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323f02a-94fc-4cb2-a3a9-09674b7b7311 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.638560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851051b5-c09b-4400-b65a-21a29d5470e1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.674261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.674949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.675232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.675508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.676050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323f02a-94fc-4cb2-a3a9-09674b7b7311 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.676489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:22.676568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.677991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.696427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 411/810] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:22.696427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.718615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.719356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.719637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.719906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.720644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:22.720948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.722279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78237f-b86b-484f-80ee-e50bdec32982 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.724592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.731724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 400/811] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:22.733656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.733941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.737961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.750122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:22.751366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:22.761067 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.803788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b85a9-3aef-4df8-8311-9ae7df9e4538 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.821214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 401/812] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:22.822223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:22.847968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.848615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.848896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.849171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:22.921933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:22.923417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:22.957208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40f87-e6d5-4528-a4b9-62732ed6dea7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:22.984675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.985436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:22.994803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:22.995891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:22.996885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:22.997174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/8cfd6158f5124d7cb71c8a77485ff6f6/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.002128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=8cfd6158f5124d7cb71c8a77485ff6f6, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.002128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.025285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 412/813] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:23.026119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.093844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 402/814] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:22 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/8cfd6158f5124d7cb71c8a77485ff6f6/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:23.095415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.131290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309171-d3c4-45a6-8f87-44a030fb1122 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.173513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.174713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.175205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.175829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.189150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.191260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:23.216541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:23.218116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:23.219106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:23.219106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:23.219106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:23.219106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:23.222731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 413/815] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:23.223843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.238294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:23.244356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded8232-a7a3-4d79-bd58-551cb382b3a5 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.282907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.284174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.284462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.284738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] PATH_INFO: `/v3/services/network` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.285433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.286797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:23.299562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:23.300605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:23.301443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 403/816] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:23.302231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.348218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5397c4-b9eb-476e-a527-bc06e15a0428 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.379400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:23.385508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.386348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.386599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.386874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.397558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.399201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:23.418204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:23.419162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:23.420045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:23.420045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:23.420045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:23.420045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:23.420045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 414/817] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:23.421232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.443277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921edab-1621-46b9-83cf-b167c76764ec None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.491323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:23.496233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.497806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.498321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.498874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.500132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:23.500642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.503368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.522653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 404/818] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:23.523803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.541619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302bca-900c-48ab-8a78-b234effb16f6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.580249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.580889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.581244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.581593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.582538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] RBAC: Adding query filter params (name=network) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:23.582779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.584349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.594741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 415/819] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:23.594741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.647721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7832-af10-43ee-9f88-af60bdf09ab4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.662170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:23.683330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.684097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.684432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.684704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.685478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:23.685785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.687921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.699314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 405/820] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:23.700140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.725875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244ba3d-3a08-49d5-ab5d-e1a020573514 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.752167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:23.761026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.761832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.764650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.764650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.770428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.772018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:23.789476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:23.790755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:23.791933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:23.793075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 416/821] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:23.793925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.831149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019623f6-c611-4768-97fb-3e2fc9b02e1a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.875143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.876437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.876874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.877611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.878779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] RBAC: Adding query filter params (type=network) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:23.879235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.881285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:23.894640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 406/822] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:23.894640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:23.918884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3dd67-0798-4de5-968e-582a7b032a97 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:23.934968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:23.969474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:23.971008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:23.971751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:23.972230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:23.981692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:23.983989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:24.003593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:24.004464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:24.005350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:24.005790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ad8de-bf70-4cd9-bd43-0392762c8140 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.008648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 417/823] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:24.009625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.041515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.042373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.042798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.043189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.044150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:24.044556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.046142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.066977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 407/824] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jun 16 11:38:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:24.068087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.074431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:24.141601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a31cf-0ce2-4e08-814d-b8ed675eb49a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.164625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:24.171302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d3edf-718d-4595-a3be-2c85f32d20bf None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.179085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.181364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.181364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.181364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.181364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.183031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.208025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.208751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.210229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.210229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.210229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:24.210623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.212084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.224465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 408/825] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:24.225152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.261986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 418/826] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:24.262291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.476808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:24.487879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cab0-3ef3-4200-bdbb-38064dcd058b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.531025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.531707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.531991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.532277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.533145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=3ad599a6997f44dbb42472277cba7bc0) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:24.533466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.534992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca8645-e8f2-401e-8f73-2ffb93b793a0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.541565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 419/827] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/role_assignments?user.id=3ad599a6997f44dbb42472277cba7bc0&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:24.563533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7fea-d494-418f-ac60-38b054f40e0d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.590160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2990-c4c0-4f63-9c48-ece64bdfbbf5 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.590494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2990-c4c0-4f63-9c48-ece64bdfbbf5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.590763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2990-c4c0-4f63-9c48-ece64bdfbbf5 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.592408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 420/828] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:24.598770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.599369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.599909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.605657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.606508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.607771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.608588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.620686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:24.621394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.622448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:24.622877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:24.648116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:24.649082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:24.650413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:24.650413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:24.650413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:24.650413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:24.650413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 409/829] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:24.656610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.668999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:24.729642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 421/830] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:24.755547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.788682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942170e-4308-486c-82f8-d85beda8c7de None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.826643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.827711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.828205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.828689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.829602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:24.830101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.831723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.846021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 410/831] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:24.851956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:24.884298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:24.897340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6e9a-d363-46c2-8c7b-27fa2351ef57 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.930600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:24.943989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:24.945518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:24.946209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:24.946683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:24.947777 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:24.950107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:24.967887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9a79-109d-4c7f-96f6-2f9336887115 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:24.969838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:24.970853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:24.971685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:24.973834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 422/832] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:24.979041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.013030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.013921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.014819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.015440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.025451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:25.027016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:25.047573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:25.048682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:25.049818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:25.050929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 411/833] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:25.056218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.096884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138407-0753-4594-b0cd-4bb2d4db1f13 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:25.137847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.138697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.139599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.139971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.140797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:25.141202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:25.143549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:25.154730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 423/834] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:25.158624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.181122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:25.188743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b193b0-a282-445d-a33d-019029fde819 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:25.223568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:25.234973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.235735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.236078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.236508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.237391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:25.237795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:25.239334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:25.255887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 412/835] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:25.263170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.272536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b85b8c-0872-47ca-b73e-c07dd5e4a995 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:25.314259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.315374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.315877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.316349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.317295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:25.317824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:25.319479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9829c5e-473c-4b8d-bbf2-fd6162475e62 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:25.331077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 424/836] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:25.372604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f6d7-0974-4348-8287-69dfc101f776 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.373222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f6d7-0974-4348-8287-69dfc101f776 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.373752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f6d7-0974-4348-8287-69dfc101f776 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.375701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 425/837] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:25.386617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.386617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.386617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.391020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5de0f8-d0c1-4a58-9572-7bbcc745d868 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:25.399712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:25.400928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:25.429871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.430802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.431086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.431362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/25a7024445c04ac4bcd168b2e8a5365b/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.448625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=25a7024445c04ac4bcd168b2e8a5365b, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:25.450075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:25.479004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 426/838] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:25.503903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.514637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 413/839] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:25 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/25a7024445c04ac4bcd168b2e8a5365b/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:25.523730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:25.633422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add04f8-1d74-40b9-b782-82096f73bf67 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:25.673889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.674730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.675017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.675297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.686730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:25.694801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:25.695741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:25.696579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 427/840] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:25.702267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.739998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:25.808471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522f295-bda8-4543-aae4-4d6df8ed6979 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:25.845059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:25.846031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:25.846498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:25.847047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:25.847986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:25.848476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:25.850072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:25.859333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 414/841] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:25.865053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:25.955792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:25.981925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af87c87-d65f-443d-a88d-f89213f3af6d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:26.017241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:26.018085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.018374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.018769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.030488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:26.031976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:26.049504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:26.050499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:26.051440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:26.051440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:26.051440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:26.051440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:26.051440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 428/842] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:26.056750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:26.162261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:26.165912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3705a-79c4-464f-ba95-cfd138be40c6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:26.200571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:26.201236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.201621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.202352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.203110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:26.203416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:26.204772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:26.217023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 415/843] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:26.222448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:26.326327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bef4b-01dc-4698-ba0a-817cc958ded6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:26.352376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:26.361093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:26.361899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.362186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.362462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] PATH_INFO: `/v3/users/swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.370207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:26.371668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:26.386343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:26.387645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:26.389091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 429/844] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:26.394100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:26.497144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794270-2420-4d44-b5b9-c0014430e30a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:26.534369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:26.535070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.535352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.535626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.536463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:26.536769 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:26.538191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792702e8-3427-4f23-993f-6c6c09258ce8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:26.556514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 416/845] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jun 16 11:38:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:26.562557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:26.666445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749d15b-6d35-445f-af9b-b66455939acd None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:26.706402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:26.707082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.707365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.707641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.763686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:26.777608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:26.779102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:26.868320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151713d-2b8a-455d-b9bf-45721b795444 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.868851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151713d-2b8a-455d-b9bf-45721b795444 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.868851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151713d-2b8a-455d-b9bf-45721b795444 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.870218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 417/846] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:26.875843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:26.876134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:26.876415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:26.889996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 430/847] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:26.895259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:26.900215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:26.901646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:26.914483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:26.986625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 418/848] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:26.996529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.007275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.012478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a87f0-e367-464b-aca4-f35ada7c940f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.047673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.048606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.049084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.049460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.060220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.062495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:27.081937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:27.083069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:27.084194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:27.084194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:27.084194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:27.084194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:27.085758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 431/849] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:27.090928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.126035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70219145-c189-4406-8acf-af0dab4cd75c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.163603 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.164822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.165203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.165999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.165999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.168172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:27.185341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:27.186909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:27.187767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:27.192653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 419/850] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:27.193607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.210779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.220833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700d398-2dba-4041-a088-20e8d7a7a728 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.261009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.262101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.262703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.263160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.264105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:27.265122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.266796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.274496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.280874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 432/851] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:27.285881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.321999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8edc5-7cc6-4634-8f80-488d6063a367 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.357127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.358697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.359189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.359668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.360604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:27.361113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.362696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.368041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 420/852] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:27.374693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.398754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d83b9-892a-4e49-9ba4-76d751c615ae None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.443636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.444540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.444890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.445236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.456888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.458360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:27.473761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:27.475035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:27.475961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 433/853] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:27.480692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.481502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.520092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c59e5-b318-40fb-ac5c-458ea85df607 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.551274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.569090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.569759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.570097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.570431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.571214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:27.571526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.573417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4191f3-a839-4673-9753-621aebcc5e61 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.580509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 421/854] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:27.586755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419ce9-5626-4afc-9185-8b482f294cc6 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.586755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419ce9-5626-4afc-9185-8b482f294cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.586755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419ce9-5626-4afc-9185-8b482f294cc6 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.586755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 422/855] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:27.593527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.593817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.594093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.607429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404997-4a28-4b3e-a1c9-3df223a4137d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.613240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:27.614461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:27.648274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.649527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.650009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.650479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.651488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:27.652051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.653945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.668622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 434/856] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:27.682697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.696092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 423/857] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:27.725989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:27.806468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.815352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e576bb4-5034-43be-a17f-ac4bc05863d7 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.835407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:27.847215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d4e5b-61f1-4a12-997f-adde58280a35 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:27.859954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.860635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.860914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.861192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.862284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=8cfd6158f5124d7cb71c8a77485ff6f6) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:27.862650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.864230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a541f-06fd-4548-b809-b23bb62b6c2c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.871642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 435/858] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:27 2022] GET /identity/v3/role_assignments?user.id=8cfd6158f5124d7cb71c8a77485ff6f6&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:27.880541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b9a3-8bde-4e5f-ba97-cc5afba0aa47 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.880788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b9a3-8bde-4e5f-ba97-cc5afba0aa47 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.881128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b9a3-8bde-4e5f-ba97-cc5afba0aa47 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.887383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:27.887383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.887383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.887383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.888049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 436/859] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:27.888146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:27.888219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:27.888458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:27.888692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:27.890187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:27.908759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:27.909998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:27.966656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 424/860] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:27 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:28.008526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 437/861] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:28.035345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:28.166728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591ec5-134c-4f1e-814e-c169a0947fd0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:28.204273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:28.214080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:28.214919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:28.215202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:28.215478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:28.229981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:28.239785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:28.240779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:28.241645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 425/862] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:38:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:28.247905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:28.362312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf43a1e-5adc-463c-ac1e-4d99c63ffb4a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:28.373085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:28.401609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:28.402293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:28.402597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:28.403115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:28.406306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:28.408785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:28.411287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:28.422815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 438/863] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:28.428393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:28.540159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb00cd-f973-418a-8394-8c4e5254e1ee None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:28.576281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:28.577415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:28.577919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:28.578397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:28.590435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:28.593673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:28.611378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:28.612472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:28.613927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:28.613927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:28.613927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:28.613927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:28.613927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 426/864] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:28.618390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:28.743518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f699c-108e-4992-a8e7-fd8645461dfd None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:28.788341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:28.789004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:28.789292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:28.789567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:28.790293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:28.790610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:28.792053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:28.807751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 439/865] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:28.814131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:28.869047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:28.941270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818afb-f424-42ed-961e-6951c1f1c516 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:28.974123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:28.974969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:28.975251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:28.975526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:28.983619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:28.985048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:29.000025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:29.000925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:29.002253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 427/866] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:38:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:29.007038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:29.038116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:29.113901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa094d-9838-4297-a74a-72864aea957a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:29.151326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:29.152027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:29.152307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:29.152578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:29.153441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:29.153751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:29.155808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:29.176043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 440/867] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jun 16 11:38:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:29.181453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:29.285919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:29.293345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05934a4-c55d-4fc7-9be4-8f250af74a59 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:29.330270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:29.330955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:29.331289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:29.331571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:29.404508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:29.406477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:29.502738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:29.506330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 428/868] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:29 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:29.511912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:29.602567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:29.615393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854748b-f3b5-472c-badd-b11b48371554 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:29.649677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:29.650463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:29.650771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:29.651048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:29.661845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:29.663317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-8ca407c0-0db6-4bfc-bb3a-2a5d07b91f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:29.681455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:29.682358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:29.683474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:29.683474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:29.683474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:29.683474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:29.683474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 441/869] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:29.688536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:29.800759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f1c5-3565-4563-9001-e0e454001e25 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:29.807161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a8e6-90ec-4553-93d4-7c4e6b7c8c36 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:29.807445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a8e6-90ec-4553-93d4-7c4e6b7c8c36 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:29.807720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a8e6-90ec-4553-93d4-7c4e6b7c8c36 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:29.809332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 442/870] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:29.814674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51148365-deb7-4486-8e67-371146133bcf None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:29.814961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51148365-deb7-4486-8e67-371146133bcf None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:29.815242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51148365-deb7-4486-8e67-371146133bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:29.834049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-51148365-deb7-4486-8e67-371146133bcf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:29.835517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-51148365-deb7-4486-8e67-371146133bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:29.838929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:29.839594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:29.839876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:29.840152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:29.840872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:29.841178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:29.843160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:29.856300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 429/871] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:29.863490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:29.918639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 443/872] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:29.942692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:29.947498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51148365-deb7-4486-8e67-371146133bcf None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:29.986123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de5c6-1f4b-4f71-81ee-d43c74589a47 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.023610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.024514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.024793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.025063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.032521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.033943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.040183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:30.050279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:30.056079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:30.056971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 430/873] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:30.057460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.080781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51148365-deb7-4486-8e67-371146133bcf None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.120396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604244fb-60dd-482a-9411-720e43eabc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.121532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604244fb-60dd-482a-9411-720e43eabc7b None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.122207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604244fb-60dd-482a-9411-720e43eabc7b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.122666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604244fb-60dd-482a-9411-720e43eabc7b None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.124666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604244fb-60dd-482a-9411-720e43eabc7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.126599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604244fb-60dd-482a-9411-720e43eabc7b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.168414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711945b7-af1b-49b5-9ea6-0e3c2e050c74 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.193639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:30.218871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 444/874] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:29 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:30.228078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.229406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.230190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.230469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.231408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:30.231718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.233382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.249342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 431/875] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:30.255490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6ac6-83b5-4efd-9e7a-d9bee422375a None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.255778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6ac6-83b5-4efd-9e7a-d9bee422375a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.256064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6ac6-83b5-4efd-9e7a-d9bee422375a None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.259041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 445/876] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:30.260166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.265991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.266281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.266557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.284545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:30.285779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:30.382311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 446/877] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:30.403785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.407313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6568c-1510-41e2-9394-6a1644ba6be9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.446347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.447032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.447318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.447587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.448414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=25a7024445c04ac4bcd168b2e8a5365b) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:30.448715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.450131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753be11-2569-46b7-b17b-cc551a0232db None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.456371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 432/878] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/role_assignments?user.id=25a7024445c04ac4bcd168b2e8a5365b&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:30.457637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d44cc-2678-410b-adbb-d77c1cc89a40 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.457927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d44cc-2678-410b-adbb-d77c1cc89a40 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.458207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d44cc-2678-410b-adbb-d77c1cc89a40 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.459735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 433/879] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:30.472833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.473130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.473416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.478677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:30.495554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:30.496986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:30.540039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588abb-18e6-4d8f-8568-6af85923c5de None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.546874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:30.586143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 434/880] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:30.590399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.591560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.592061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.592522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.593407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.595102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:30.608973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:30.610033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:30.610920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:30.612968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.617801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 447/881] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:30.627025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.746329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f58c0-e7dc-4dc3-ad51-327e7b81a743 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.754524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9300b-c839-42a5-b574-b4b1bb5122d3 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.794023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.795119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.796058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.796424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.796832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:30.797080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.798534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.799703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.800672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.800964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.801627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.802515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:30.802985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.804589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.809723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 448/882] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:30.817196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:30.818166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:30.819567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 435/883] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:30.820368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.823530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:30.877166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:30.936955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daba47-5f6d-46ff-9c98-364822f1aee6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.959364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa98f4a-54b1-4a48-9112-14f3d8a1dc69 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:30.989064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.989744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.990026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:30.990426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:30.991332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:30.991641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:30.993672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:30.998422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:30.999366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:30.999870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:31.000362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:31.001279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:31.001793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:31.003414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:31.005483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 449/884] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:31.014786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 436/885] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:31.017408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:31.077503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:31.131277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a1617-7bd2-429c-9781-c1a1d8f5364b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:31.169843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:31.170549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:31.170874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:31.171150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:31.171863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:31.172173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:31.173568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:31.179047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 450/886] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:31.184766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:31.281334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:31.285032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e844-736c-4c07-b147-8dbb5470f27b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:31.318942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:31.320281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:31.320563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:31.320840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:31.321621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] RBAC: Adding query filter params (interface=public, service_id=dd5deebb2ccd4771a677f37c7a7c1d19, region_id=RegionOne) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:31.321933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:31.323316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace27d35-fb46-4d51-ac2e-9581b6fbbd67 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:31.329213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 437/887] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:31 2022] GET /identity/v3/endpoints?service_id=dd5deebb2ccd4771a677f37c7a7c1d19&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:31.334757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:31.442811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54fd1e-6d6d-4586-8529-b310d0b26e9d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:31.460702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:31.479298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff28b-2b2b-446d-b5be-2c92d058225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:31.480392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff28b-2b2b-446d-b5be-2c92d058225a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:31.480881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff28b-2b2b-446d-b5be-2c92d058225a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:31.481361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff28b-2b2b-446d-b5be-2c92d058225a None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:31.482240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff28b-2b2b-446d-b5be-2c92d058225a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:31.483999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff28b-2b2b-446d-b5be-2c92d058225a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:31.490276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 451/888] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:31 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:38:32.429609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeea5-a40a-4809-908c-7899b49781a5 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:32.430133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeea5-a40a-4809-908c-7899b49781a5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:32.430133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeea5-a40a-4809-908c-7899b49781a5 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:32.431816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 438/889] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:32.437080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:32.437467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:32.437633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:32.454176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:32.455389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:32.526695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 452/890] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:32.543931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeea5-a40a-4809-908c-7899b49781a5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:32.647668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeea5-a40a-4809-908c-7899b49781a5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:32.681295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:32.682024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:32.682299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:32.682565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:32.683241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:32.684710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-793b3802-7331-4ca5-98ff-101700c0f7b6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:32.697689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:32.698689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:32.699560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:32.702683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 439/891] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Jun 16 11:38:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:32.705679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:32.816562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac6afb-1507-4818-b1ff-6af4c511fe28 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:32.827277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e01f-acad-4cfd-9c20-3310b732d286 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:32.827448 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e01f-acad-4cfd-9c20-3310b732d286 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:32.827645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e01f-acad-4cfd-9c20-3310b732d286 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:32.829304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 440/892] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:32.833804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:32.835479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:32.836036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:32.836503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:32.858833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:32.860506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:32.862475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:32.864548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:32.864990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:32.865433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:32.866454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:32.867100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:32.868828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:32.875946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 453/893] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:32.885278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:32.892394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:32.958681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 441/894] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:32.975583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.019524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6168aa-3c5c-47c3-a5aa-78ccac783ca0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.064373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.065485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.065971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.066454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.067393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:33.067904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.069948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.078418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 454/895] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:33.084069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.100738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa4b4-bd7e-43a8-8339-690d910f0e39 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.125985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:33.140770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.142359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.142933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.143420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.158892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:33.168808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:33.169822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:33.170737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 442/896] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jun 16 11:38:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:33.177266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.197750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:33.214554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01e83-ee93-40b1-8cf7-204a51c39737 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.253257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.253932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.254217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.254493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.256143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] RBAC: Adding query filter params (interface=public, service_id=4ed247220b274d8a81c7cdb2c6ff8e44, region_id=RegionOne) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:33.256143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.258033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941c0e0-a9b5-41a4-a192-0c74f20a539f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.268758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 455/897] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/endpoints?service_id=4ed247220b274d8a81c7cdb2c6ff8e44&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:33.268758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc1da-085b-425f-8368-734cd5f34d1a None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.268758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc1da-085b-425f-8368-734cd5f34d1a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.268758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc1da-085b-425f-8368-734cd5f34d1a None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.272585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 456/898] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:33.273367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacc1da-085b-425f-8368-734cd5f34d1a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.311878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec09b6-ccb7-49cb-bcee-f77b73c7b9b3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.350074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.351180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.351672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.352141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.353074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:33.353590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.355161 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f96f-388f-4390-ab73-3d0c775c437b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.367831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 443/899] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:33.369396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.369880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.370348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.388085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:33.389652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:33.424542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacc1da-085b-425f-8368-734cd5f34d1a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.426100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:33.467637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.468270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 444/900] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:33.468690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.469803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.470259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.470730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.471614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.472981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.487912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:33.498905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 457/901] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/services => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:38:33.498905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.629718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a115d06-8959-450b-971d-81f488506ef9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.676949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe796-1cee-4b93-a49d-19cf674b26b2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.677392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.678217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.678499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.678797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.699972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.702812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-ea2b8520-598d-41c3-b560-fd5c84201bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:33.726773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:33.727688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:33.729006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:33.729006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:33.729006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:33.729006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:33.729006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 445/902] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:33.729485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e7fe-7470-4389-9700-71c37a95c1dd None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.729771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e7fe-7470-4389-9700-71c37a95c1dd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.730049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e7fe-7470-4389-9700-71c37a95c1dd None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.733333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 446/903] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:33.736683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31e7fe-7470-4389-9700-71c37a95c1dd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.743075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691c1b-626c-4e18-ae7b-b380831dd22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.743719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691c1b-626c-4e18-ae7b-b380831dd22a None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.744000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691c1b-626c-4e18-ae7b-b380831dd22a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.744270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691c1b-626c-4e18-ae7b-b380831dd22a None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.744987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691c1b-626c-4e18-ae7b-b380831dd22a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.746485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4691c1b-626c-4e18-ae7b-b380831dd22a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.796972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:33.828632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 458/904] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:33 2022] POST /identity/v3/services => generated 241 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:33.830005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.830297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.830571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.852984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31e7fe-7470-4389-9700-71c37a95c1dd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:33.856671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:33.857099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:33.882462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:33.898328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:33.899289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:33.899706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:33.900158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:33.901086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:33.901546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:33.904427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:33.920802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 447/905] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:33.926388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:33.957248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 459/906] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:33.981881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.053588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4179ee-8200-462d-a417-759a8e4e68b6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.080879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:34.103066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce865b3-853d-406f-958e-eaa31e984829 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.104868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.106611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.106912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.107233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.119420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.121130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:34.139247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:34.140208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:34.141176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 448/907] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:34.143719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.144526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.144901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.145451 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.145965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.146141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.147527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:34.164138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:34.165855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:34.166977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 460/908] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:34.174456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.201311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:34.260956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec172db-3fbd-4853-b17f-8aed3b2694d8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.289350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49de4f3-9212-442a-847e-267d284fb129 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.294934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.296143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.296424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.296694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.297527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:34.297833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.299290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.322977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 449/909] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jun 16 11:38:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:34.323904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.331420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.332481 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.333010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.333482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.334609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:34.335127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.336818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.342910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 461/910] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:34.350843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.367531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:34.455069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff315fc-8217-4271-82d2-893fe37f99f5 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.460066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:34.478817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf054e4d-922f-48d9-9008-effe5d1b89ca None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.501889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.503060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.503484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.504411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.520159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.521227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.521613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.521995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.522995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:34.523408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.525538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.532427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 462/911] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jun 16 11:38:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:34.537300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.589792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.591550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.627756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:34.680313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18ec56-5fb0-4f11-877f-c43f9be51200 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.703895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 450/912] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:34.709026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.723143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.724332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.724814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.725267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.726177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.728029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.807271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 463/913] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:34.831690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1632ea-b2ff-4c21-9608-3149780d80a2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:34.876314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:34.882989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:34.889602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:34.889602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:34.889602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:34.898270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:34.899787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:34.920490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:34.921465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:34.922352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:34.922352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:34.922352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:34.922352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:34.922352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 451/914] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:34.927562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:34.943010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:35.037473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0512-46fe-463b-a78b-3380ed070ad0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:35.072407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:35.072990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:35.073321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:35.073601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:35.074320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:35.074642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:35.076002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:35.088951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 464/915] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:35.094876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:35.206846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ff08-bb6d-4286-a1e0-7d9b7a438062 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:35.241688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:35.242489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:35.242800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:35.243073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:35.250549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:35.252008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:35.266361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:35.268428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:35.270502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 452/916] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:35.274619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:35.338044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:35.383837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45cc46-2da8-4792-8186-d612f81f569d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:35.425100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:35.425758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:35.426036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:35.426308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:35.427123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:35.427431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:35.428850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c516614-cf69-4eed-b8eb-688a9044a089 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:35.441431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 465/917] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:35.450278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:35.512037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:35.571055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e55b9-c4cc-4107-b47f-274b71f86372 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:35.607210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:35.607813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:35.608096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:35.608377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:35.609244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] RBAC: Adding query filter params (role.id=c87e6081b4ce49d7ba604fb9b1e2be49, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=25a7024445c04ac4bcd168b2e8a5365b) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:35.609559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:35.611135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e6f47-ed20-4848-a0ac-33a78f598564 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:35.617800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 453/918] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:35 2022] GET /identity/v3/role_assignments?user.id=25a7024445c04ac4bcd168b2e8a5365b&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=c87e6081b4ce49d7ba604fb9b1e2be49 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:35.760327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9990-293a-4b5a-952f-3d79d4b39755 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:35.760327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9990-293a-4b5a-952f-3d79d4b39755 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:35.760327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9990-293a-4b5a-952f-3d79d4b39755 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:35.760327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 466/919] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:35.769622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:35.769622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:35.769622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:35.786420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:35.787987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:35.872649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 454/920] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:35.901704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b9990-293a-4b5a-952f-3d79d4b39755 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.010396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b9990-293a-4b5a-952f-3d79d4b39755 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.043117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:36.054716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.062550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.062550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.062550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.062550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.062550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c46a39d1-14a3-4821-9fb7-8e2f573193ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:36.071540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:36.072821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:36.074191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 467/921] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Jun 16 11:38:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:36.079745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.121684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:36.152291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea13cf0-bcf1-4d38-a3e4-3d8140fbcaf7 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.153571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea13cf0-bcf1-4d38-a3e4-3d8140fbcaf7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.154703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea13cf0-bcf1-4d38-a3e4-3d8140fbcaf7 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.156804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 468/922] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:36.161522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.161924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.162611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.180449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:36.181651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:36.196508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706acec-a7c4-491a-9774-961b78ee9b8d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.233237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.233898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.234179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.234455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.235203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:36.235509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.236868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.242096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 455/923] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:36.247286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.271788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 469/924] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:36.293468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.356402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:36.360211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af429dd-9caa-41e1-8810-1d39476b03d6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.397004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.397902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.398249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.398737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.399524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:36.399894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.401744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.407914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 456/925] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:36.410863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2509b6-daab-484d-9089-33f2c73f5bb7 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.413545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.435696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:36.455162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.456136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.456398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.456678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.457383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.458709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:36.476756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:36.477847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:36.478733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:36.480879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 470/926] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:36.488724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.537490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8ca7-f6c0-4530-acc9-5ffbb39b65d3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.576510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.577523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.577977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.578407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.579355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.581165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.613835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6308c95-6ea1-412e-8d1c-07d292e39adc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.648274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.648929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.649214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.649488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.650180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:36.650482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.651889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.657430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 471/927] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:36.667974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.702856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 457/928] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:36.724636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:36.786778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889c9cc-dc62-4928-937f-b7636257c21a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:36.832860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:36.833534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:36.833812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:36.834085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:36.834887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:36.835256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:36.836702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:36.843584 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 472/929] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:36.849471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:36.877224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:36.971616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872452fd-bef9-40e6-9f57-03c5caf9d35a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:37.007532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:37.008186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.008466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.008738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.009518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] RBAC: Adding query filter params (interface=public, service_id=b991c872e076454dbd8f4187ad2473a5, region_id=RegionOne) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:37.009828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:37.011265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576f2aa-176b-435e-abc7-761b9b51178f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:37.017335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 458/930] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:36 2022] GET /identity/v3/endpoints?service_id=b991c872e076454dbd8f4187ad2473a5&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:37.022754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:37.126803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d1651-806f-490c-826a-87efe025051e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.127145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d1651-806f-490c-826a-87efe025051e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.127362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d1651-806f-490c-826a-87efe025051e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.128465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef255ee0-b0a8-4f2c-ba84-d44dbb6349eb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:37.128961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 459/931] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:37.134975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.135263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.135543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.136441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:37.154098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:37.155878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:37.175329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:37.176184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.176648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.177222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.178505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:37.180210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:37.189716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 473/932] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:37 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:38:37.239276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 460/933] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:37.259395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:37.370004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a96c-7c33-4d73-a2cd-35875980b34f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:37.405208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:37.405923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.406206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.406478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.407202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:37.408622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:37.409991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING keystone.server.flask.common [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 11:38:37.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.sql.core [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 11:38:37.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 11:38:37.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [parameters: {'id': 'af2c05fdb5214f36b3f041c263b427f2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 11:38:37.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91905) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af2c05fdb5214f36b3f041c263b427f2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af2c05fdb5214f36b3f041c263b427f2. Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application conn.query(q) Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 11:38:37.473502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result.read() Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 11:38:37.474373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application next(self.gen) Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application yield resource Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application next(self.gen) Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise self.value Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application session.commit() Jun 16 11:38:37.475370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.session.flush() Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application compat.raise_( Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 11:38:37.476261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 11:38:37.477158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application conn.query(q) Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result.read() Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 11:38:37.478036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [parameters: {'id': 'af2c05fdb5214f36b3f041c263b427f2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:37.480912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:37.487096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af2c05fdb5214f36b3f041c263b427f2. Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:37.489258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 474/934] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Jun 16 11:38:37 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:37.494682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:37.509127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:37.601836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221d2d-9bb9-4c07-aa03-a870ef320e21 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:37.636998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:37.637808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.638088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.638393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.645670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:37.647145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-2822eac2-2577-4f37-a1d9-020feea66ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:37.661753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:37.662706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:37.663763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 461/935] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:37.671517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:37.701851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:37.787969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706d252-f664-48fe-af3f-c383ceb24907 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:37.829659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecf0a-e314-436e-8d11-a7f17ff9fbb7 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.829967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecf0a-e314-436e-8d11-a7f17ff9fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.830214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecf0a-e314-436e-8d11-a7f17ff9fbb7 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.831681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:37.831833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 462/936] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:37.832666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.832951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.833223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.833978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:37.834281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:37.838419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:37.839868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:37.840929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:37.841413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:37.858109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 475/937] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:37.864115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:37.865736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:37.952227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 463/938] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:37.975809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:38.069470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:38.084834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98924d7-ad34-4669-907b-0728a8325c72 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:38.126959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:38.127774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:38.128055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:38.128331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:38.140104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:38.148323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:38.149273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:38.150121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 476/939] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jun 16 11:38:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:38.157234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:38.160299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:38.266098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbff08e-9d4e-43f5-91c7-9a590463c96b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:38.300138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:38.301159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:38.301677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:38.302157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:38.303138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:38.303642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:38.305193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:38.315009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 464/940] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:38:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:38.320515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:38.431183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6a27-184a-4d5a-bfcc-3d1d9eab642d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:38.471442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:38.472241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:38.472579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:38.472857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:38.484045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:38.485498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:38.492331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:38.504703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:38.512347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:38.513233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:38.513233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:38.513233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:38.513233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:38.513233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 477/941] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:38.516552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:38.589057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:38.620398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a0bca-b999-45fa-b16a-8326e9799587 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:38.654770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:38.655422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:38.655702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:38.655975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:38.656689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:38.656995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:38.658336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:38.671714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 465/942] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:38.679656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:38.784167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e698b00-001f-48a2-9c2b-92b9b39c1a62 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:38.819465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:38.821357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:38.821642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:38.821921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:38.830324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:38.831816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-807baff2-6df5-4d34-8e86-40693888d53c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:38.846746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:38.847698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:38.849045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 478/943] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:38:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:38.855819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:38.974235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b0df9-4f40-497f-86d3-3417f6b03928 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.003166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.012419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b9a8-e764-44f1-a8a5-903fba37c485 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.012733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b9a8-e764-44f1-a8a5-903fba37c485 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.012990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b9a8-e764-44f1-a8a5-903fba37c485 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.014779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.015779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.016277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.016750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.017814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:39.018099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 479/944] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:39.018563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.019511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.019986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.020370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.020723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.038756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:39.040402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:39.045666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 466/945] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jun 16 11:38:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:39.047826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.105934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.130633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 480/946] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:39.147809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.170530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2e50-077e-4cca-9bdb-1dd6b72d6657 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.208303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.209466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.209928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.210380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.222177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.223884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:39.242442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:39.243390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:39.244278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:39.244278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:39.244278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:39.244278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:39.251433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 467/947] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:39.252723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.276569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec741-9cad-4150-8411-fdc4fb3a208b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.296003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.327816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.328973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.329620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.330129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.331410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.333365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:39.349240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:39.350279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:39.351185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 481/948] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:39.359621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.366375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072003d-472e-480b-95d7-83f1e459effb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.402172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.402905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.403192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.403476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.404217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:39.404590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.406084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.424383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 468/949] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:39.425858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.432171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.487765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e28a-5e3e-4d31-9e02-5aec5ca4bd90 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.524076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.524732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.525065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.525338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.525989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:39.526377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.527686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e164b-3b16-4f09-b931-f4b6d8dd4ee7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.528085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.532596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 482/950] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:39.534153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87554cc-261b-46c2-9f9d-35159878ff04 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.534279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941c0f-b92d-466d-81a9-d92b4f89192c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.534458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87554cc-261b-46c2-9f9d-35159878ff04 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.534753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87554cc-261b-46c2-9f9d-35159878ff04 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.536063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 483/951] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:39.538038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87554cc-261b-46c2-9f9d-35159878ff04 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.580565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.581362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.581639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.587146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.589284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.590789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-fea3fab3-477a-4041-a793-0b4ac06257de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:39.606102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:39.607072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:39.608550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 469/952] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:39.609540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.609540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.609757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.627714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:39.629010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:39.649769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87554cc-261b-46c2-9f9d-35159878ff04 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.667697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.686261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.686953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.687238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.687519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.688262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:39.688841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.690301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.694864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 484/953] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:39.695877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.701873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 470/954] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:39.726167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.820196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c66b6-31e3-4442-9a3a-0c217dd87c6c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.862606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.868252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.869242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.869242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.869519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.870373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:39.870600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.872894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.891405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c8a41-c9b6-4d47-98e7-86dc42ef89d6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:39.891568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 485/955] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:39.891568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:39.933415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:39.934355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:39.934825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:39.935237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:39.936146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:39.937601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:39.938412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:39.952056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:39.957970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:39.958921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 471/956] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:39.959818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:40.011055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf54d4-8d4b-4f1a-b23e-50abff1b50a9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:40.059526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b34698-57dd-4bdd-a1aa-f83eb8932186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:40.060513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b34698-57dd-4bdd-a1aa-f83eb8932186 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.061431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b34698-57dd-4bdd-a1aa-f83eb8932186 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.061775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b34698-57dd-4bdd-a1aa-f83eb8932186 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/25a7024445c04ac4bcd168b2e8a5365b/roles/c87e6081b4ce49d7ba604fb9b1e2be49` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.065221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b34698-57dd-4bdd-a1aa-f83eb8932186 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=25a7024445c04ac4bcd168b2e8a5365b, role_id=c87e6081b4ce49d7ba604fb9b1e2be49)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:40.067035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b34698-57dd-4bdd-a1aa-f83eb8932186 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:40.077525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b7887-f40c-41af-a57b-ddd73a8a63c3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:40.112333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:40.113036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.113264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.113532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.114236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:40.114536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:40.115908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:40.126095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 472/957] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:40.127100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:40.136798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 486/958] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:39 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/25a7024445c04ac4bcd168b2e8a5365b/roles/c87e6081b4ce49d7ba604fb9b1e2be49 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:40.157620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:40.266488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5a3c0-f674-451d-a2b4-dedc6478d522 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:40.306065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:40.307167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.307451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.307728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.308441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:40.308747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:40.310117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:40.312080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a3fd8-5d82-445a-b56c-8fb38a24163f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.312591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a3fd8-5d82-445a-b56c-8fb38a24163f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.313063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a3fd8-5d82-445a-b56c-8fb38a24163f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.316922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 473/959] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:40.317757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 487/960] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:40.322031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:40.323528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.324022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.324492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.344869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:40.346290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:40.408976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:40.437409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1998-6ee3-48ae-a818-f4745e080f04 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:40.443029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 488/961] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:40.463721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:40.475999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:40.477058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.477607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.477886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.478668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:40.480842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:40.500784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:40.562198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 474/962] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:40.582524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7640-a198-4bb7-a246-df62f899fe55 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:40.632807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:40.633803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.634239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.634696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.635598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:40.637226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:40.679694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.sql.core [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 11:38:40.679694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 11:38:40.679694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [parameters: {'user_id': 'a1d6f5717b3647c6a58953977343479b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 11:38:40.679694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91905) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application conn.query(q) Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result.read() Jun 16 11:38:40.688360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 11:38:40.689815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application next(self.gen) Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application yield resource Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application next(self.gen) Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise self.value Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application session.commit() Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 11:38:40.691014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.session.flush() Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application compat.raise_( Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 11:38:40.692112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 11:38:40.693216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application conn.query(q) Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application result.read() Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 11:38:40.694260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a1d6f5717b3647c6a58953977343479b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:40.695293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 11:38:40.696091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 11:38:40.696977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 11:38:40.696977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 11:38:40.696977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 11:38:40.696977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 11:38:40.696977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 11:38:40.696977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:40.704256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 489/963] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jun 16 11:38:40 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:40.705937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:40.815853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d7fa-718c-4356-9809-f8aa7835eaf6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:40.853039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:40.854419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:40.854735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:40.855011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:40.857479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:40.864741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:40.866203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-ca1d29cf-915c-41bf-84d8-fe9542123de4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:40.881143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:40.882220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:40.883587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 475/964] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:40.890881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:40.989579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:41.002407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca03a9-2ce1-4ebe-9ec2-c43398f6119a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:41.037996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:41.040686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:41.040686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:41.040686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:41.040686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:41.040686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:41.042130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b00ff-8d7c-459e-ab7b-8e82f10d5e05 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:41.084438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 490/965] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jun 16 11:38:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:41.928814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8fbc6-42df-473d-9497-ad3eb1abd0ae None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:41.929355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8fbc6-42df-473d-9497-ad3eb1abd0ae None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:41.929355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8fbc6-42df-473d-9497-ad3eb1abd0ae None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:41.930900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 476/966] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:41.936439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbc59-7eed-4cc0-9e3f-8eb27c134bb6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:41.936827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbc59-7eed-4cc0-9e3f-8eb27c134bb6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:41.936999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbc59-7eed-4cc0-9e3f-8eb27c134bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:41.954567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ec9fbc59-7eed-4cc0-9e3f-8eb27c134bb6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:41.956097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ec9fbc59-7eed-4cc0-9e3f-8eb27c134bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:42.023719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 491/967] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:42.046092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8fbc6-42df-473d-9497-ad3eb1abd0ae None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:42.149113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8fbc6-42df-473d-9497-ad3eb1abd0ae None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:42.181872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a68b0-b7e9-4ab2-ad49-624999d1fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:42.182526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a68b0-b7e9-4ab2-ad49-624999d1fe06 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.182835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a68b0-b7e9-4ab2-ad49-624999d1fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.183111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a68b0-b7e9-4ab2-ad49-624999d1fe06 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.183837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a68b0-b7e9-4ab2-ad49-624999d1fe06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:42.185185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a68b0-b7e9-4ab2-ad49-624999d1fe06 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:42.314630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 477/968] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:42 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:42.364231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486169-f270-4d02-91ab-f3ed74efee6a None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.364577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486169-f270-4d02-91ab-f3ed74efee6a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.364789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486169-f270-4d02-91ab-f3ed74efee6a None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.366436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 492/969] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:42.372046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.372351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.372682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.391056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:42.392288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:42.446699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:42.474719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 478/970] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:42.495788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486169-f270-4d02-91ab-f3ed74efee6a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:42.588353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:42.612685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486169-f270-4d02-91ab-f3ed74efee6a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:42.649916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663c616-4616-4fcb-9674-4c90a22f3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:42.651042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c616-4616-4fcb-9674-4c90a22f3b87 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.651495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c616-4616-4fcb-9674-4c90a22f3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.651919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c616-4616-4fcb-9674-4c90a22f3b87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.663202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663c616-4616-4fcb-9674-4c90a22f3b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3663c616-4616-4fcb-9674-4c90a22f3b87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:42.672264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:42.673486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:42.674532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:42.681700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 493/971] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jun 16 11:38:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:42.683104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:42.755725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83164-3d41-4f66-8725-ac9116496bff None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.755936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83164-3d41-4f66-8725-ac9116496bff None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.756226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83164-3d41-4f66-8725-ac9116496bff None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.757797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 494/972] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:42.762671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.762965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.763249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.780348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:42.781542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:42.789721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25b05d-2fa4-4de5-8ba0-237e92c8ad7d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:42.834611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:42.835300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.835582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.835853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:42.839111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:42.839430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:42.840813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:42.854115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 479/973] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:38:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:42.855365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:42.862616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 495/974] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:42.885043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:42.904195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:42.952237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:42.961329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ce285-e4ad-486e-a27a-8b73c7f180a7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:42.989076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dc0da-ed3d-468f-9bf7-77450f38a791 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:42.996971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:42.997767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:42.998050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:42.998354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.009092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.010480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.025336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.026137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.026464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.026771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.027477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:43.028063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:43.028907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:43.030396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:43.030396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:43.030396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:43.030396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:43.030657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.030728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 480/975] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:43.035410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:43.043382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:43.044715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:43.045664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 496/976] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:43.050818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.135178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:43.142761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf481228-d010-40c2-830c-b8c0b275959e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.156105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a28a-9118-49cf-9580-720a00f0edcf None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.177068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.177771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.178249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.178767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.180087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:43.180628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.183159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.184896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:43.192469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.193146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.198568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.198568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.198568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:43.198568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.198568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.199301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 481/977] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:43.206519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 497/978] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:43.207487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.208705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.310379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67d3bf-06c6-49b8-9178-e1525916b152 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.317586 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96384085-9153-40ea-b8da-927a9b9726ec None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.349833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.350699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.350959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.351235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.353073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.353719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.354413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.354413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.354972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:43.355277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.356618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.359898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.361605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.361722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 482/979] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:43.367040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:43.376545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:43.377518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:43.378513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 498/980] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:43.383006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.388454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:43.442396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:43.473232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01877-ceec-4ce1-a2f6-c547b617f945 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.489235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f201a-916e-4794-91a0-67cbe0c5a79a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.508010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.508665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.508943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.509210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.510005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] RBAC: Adding query filter params (interface=admin, service_id=b991c872e076454dbd8f4187ad2473a5, region_id=RegionOne) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:43.510314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.511702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.522067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 483/981] 10.222.0.36 () {56 vars in 1249 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/endpoints?service_id=b991c872e076454dbd8f4187ad2473a5&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:43.522747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.528024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.528696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.528977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.529253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.531214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:43.531688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.533340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.553468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 499/982] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:43.558786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.611572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:43.630806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079085-1d92-4a82-9021-e0a6a0a2c297 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.658365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45861-7680-417e-90ee-c9ee0d29815c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:43.665505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.666230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.666511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.666831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.667615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.669067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.671705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:43.686623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 484/983] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:38:43.692899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:43.693567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:43.693852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:43.694129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:43.769001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:43.770483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:43.875505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 500/984] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 11:38:43.881169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:43.981216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fa9f-e557-468f-a70e-4fdd9c0ab8a7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.015196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.015989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.016268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.016539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.026628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.028044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.034713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:44.046561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:44.047872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:44.048786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:44.048786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:44.048786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:44.048786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:44.049567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 485/985] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:44.053557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:44.070123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:44.159016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3079f-2d19-4f54-8955-e8e802d6baec None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.193308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.193967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.194249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.194523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.195270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:44.195576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.196944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.216359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 501/986] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:44.218401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:44.317368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51979-2949-4ca8-9d4c-9be1ba7ff502 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.350755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.351546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.351823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.352094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.359287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.360702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-1846183c-434c-4f66-abbd-d0838e8ab690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:44.374249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:44.375338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:44.376252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:44.377216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 486/987] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:44.381106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:44.458484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:44.490632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b6a9e-8628-4f37-a4d5-063164ff3353 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.506097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46700-a8c1-43fe-b74e-bc961ea1a883 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.506379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46700-a8c1-43fe-b74e-bc961ea1a883 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.506707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46700-a8c1-43fe-b74e-bc961ea1a883 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.508193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 487/988] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:44.512919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.513217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.513503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.527949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.528614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.528902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.529184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.530652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:44.530971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.531068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:44.532206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:44.532409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.551372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 502/989] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:44.552852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:44.587296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:44.606633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 488/990] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:44.625111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:44.664811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20fa83-4b2c-44db-9703-636917ea477e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.698190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:44.704006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.704660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.704941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.705215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.706083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] RBAC: Adding query filter params (role.id=c87e6081b4ce49d7ba604fb9b1e2be49, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=25a7024445c04ac4bcd168b2e8a5365b) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:44.706395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.707850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.719180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 503/991] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/role_assignments?user.id=25a7024445c04ac4bcd168b2e8a5365b&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=c87e6081b4ce49d7ba604fb9b1e2be49 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:44.736097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d83c-3362-4b0a-94a6-a22c6337ffb3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.774437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.775297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.775583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.775859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] PATH_INFO: `/v3/services/compute` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.776533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.777942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:44.791226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:44.792331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:44.793175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 489/992] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:44.798447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:44.915301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d742-9ed3-4508-9815-3b1da753e417 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:44.952159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:44.952828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:44.953110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:44.953386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:44.954105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] RBAC: Adding query filter params (name=compute) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:44.954414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:44.955928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:44.961183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 504/993] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:44.966782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:45.020787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:45.067839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56ab69-ede8-43de-a40b-c0973e7f6cbe None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:45.100714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:45.101369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:45.101648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:45.101918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:45.102638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:45.102944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:45.104282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:45.113731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 490/994] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:45.115191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:45.174336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:45.215243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b962-9dd7-4908-88a2-d9b02a24675c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:45.249172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:45.249825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:45.250103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:45.250374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:45.251188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] RBAC: Adding query filter params (interface=public, service_id=53735912b35d41279f718544d982e68f, region_id=RegionOne) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:45.251499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:45.252858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccd42-7e09-421a-adef-3e01fff497f9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:45.262529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 505/995] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:45 2022] GET /identity/v3/endpoints?service_id=53735912b35d41279f718544d982e68f&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:45.264508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:45.362660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b2ec-4e39-4627-9f49-c11cf8448e36 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:45.378900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:45.396703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c612-20f5-4575-8041-8e7324508d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:45.397364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c612-20f5-4575-8041-8e7324508d6a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:45.397655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c612-20f5-4575-8041-8e7324508d6a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:45.397912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c612-20f5-4575-8041-8e7324508d6a None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:45.398607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39c612-20f5-4575-8041-8e7324508d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:45.399948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39c612-20f5-4575-8041-8e7324508d6a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:45.410628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 491/996] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:45 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:38:45.876836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59390c-b612-4d0e-b054-a8b8dd949f7b None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:45.877234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59390c-b612-4d0e-b054-a8b8dd949f7b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:45.877410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59390c-b612-4d0e-b054-a8b8dd949f7b None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:45.879782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 506/997] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:45.884475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:45.884769 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:45.885049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:45.902194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:45.903421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:45.969542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 492/998] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:45.992325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59390c-b612-4d0e-b054-a8b8dd949f7b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:46.095752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59390c-b612-4d0e-b054-a8b8dd949f7b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:46.119085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:46.139867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:46.139867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:46.139867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:46.139867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:46.140232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:46.140232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:46.145774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:46.154887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:46.156013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 507/999] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jun 16 11:38:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:46.157002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:46.253535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1d538-c28d-4f02-95ee-b5d7c0d224f9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:46.263882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:46.287014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:46.288010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:46.288468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:46.288919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:46.289788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:46.290241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:46.291854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:46.297261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 493/1000] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:46.303668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:46.401275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535621-d13a-4fb4-94f6-2e69a7ccdb37 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:46.434713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:46.435376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:46.435688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:46.435964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:46.436664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:46.436971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:46.438331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7510212-cb4f-4f80-9ee8-a0905a4c7ddb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:46.443727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 508/1001] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jun 16 11:38:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:46.449127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:46.550527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12287-fd28-4e3a-9851-59af23f9c83a None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:46.584994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87199c-4444-4b31-8847-631fbaa0ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:46.585675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87199c-4444-4b31-8847-631fbaa0ac1f None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:46.585934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87199c-4444-4b31-8847-631fbaa0ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:46.586370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87199c-4444-4b31-8847-631fbaa0ac1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:46.587157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87199c-4444-4b31-8847-631fbaa0ac1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:46.588512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87199c-4444-4b31-8847-631fbaa0ac1f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:46.639474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 494/1002] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:46.914354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113509-2c99-4d6d-b5bf-a4fa8408facd None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:46.914675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113509-2c99-4d6d-b5bf-a4fa8408facd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:46.914950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113509-2c99-4d6d-b5bf-a4fa8408facd None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:46.916479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 509/1003] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:46.921464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:46.921757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:46.922029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:46.939323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:46.940501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:46.968657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:47.013599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 495/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:47.036345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30113509-2c99-4d6d-b5bf-a4fa8408facd None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:47.090532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:47.139783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30113509-2c99-4d6d-b5bf-a4fa8408facd None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:47.173442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:47.174227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.174508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.174824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] PATH_INFO: `/v3/services/image` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.175531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:47.176937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:47.189422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:47.190452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:47.191968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:47.194949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 510/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Jun 16 11:38:47 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:47.196482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:47.292812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03ec6-0daf-43a1-a607-4fed2314bbdf None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:47.326120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:47.327375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.327653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.327920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.328613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] RBAC: Adding query filter params (name=image) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:47.328912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:47.330248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ade5d-5be8-4111-a809-0996b53ae867 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:47.336077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 496/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:47.340514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:47.442743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8268714-3193-4809-a584-79a485e3f9ac None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:47.459065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:47.476452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:47.477118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.477395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.477671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.478369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] RBAC: Adding query filter params (type=image) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:47.478701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:47.480094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923830fb-dd1c-4e8c-8c8a-4df5facdfa4f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:47.490645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 511/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:47.564448 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3b48-3a90-42db-bbe0-0906d239907f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.564759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3b48-3a90-42db-bbe0-0906d239907f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.565030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3b48-3a90-42db-bbe0-0906d239907f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.566443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 497/1008] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:47.571950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.572247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.572533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.590616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:47.591883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:47.667309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 512/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:47.691139 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3b48-3a90-42db-bbe0-0906d239907f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:47.716689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:47.796263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3b48-3a90-42db-bbe0-0906d239907f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:47.830457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:47.831272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.831551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.831819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.832458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:47.833797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:47.845477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:47.846476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:47.847354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 498/1010] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:47.854638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:47.958276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfa56-305e-4325-8b2a-fc3c476bbcd5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:47.969469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:47.992349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:47.993052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:47.993342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:47.993606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:47.994305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:47.994629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:47.995985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:48.005416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 513/1011] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:48.006669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:48.099616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:48.112284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27d0e-6596-4950-8aa8-25d08a9f5f73 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:48.145391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:48.146057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:48.146340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:48.146633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:48.147338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:48.147642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:48.148994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de30ab-cca1-45ea-8e78-dde7cc0f94f6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:48.158548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 499/1012] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jun 16 11:38:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:48.160443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:48.262836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27513a7b-8c3f-4409-8336-61b50ec399b3 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:48.296765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446219-f0c5-4c74-a607-ede16f792814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:48.297414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446219-f0c5-4c74-a607-ede16f792814 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:48.297692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446219-f0c5-4c74-a607-ede16f792814 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:48.297962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446219-f0c5-4c74-a607-ede16f792814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:48.298721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446219-f0c5-4c74-a607-ede16f792814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:48.300071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446219-f0c5-4c74-a607-ede16f792814 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:48.382615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 514/1013] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:48.773429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922b472-db68-4af6-9bcd-3addcac81407 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:48.773947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922b472-db68-4af6-9bcd-3addcac81407 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:48.774058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922b472-db68-4af6-9bcd-3addcac81407 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:48.775414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 500/1014] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:48.780582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:48.780872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:48.781154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:48.797782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:48.799000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:48.823004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:48.874127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 515/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:48.898275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922b472-db68-4af6-9bcd-3addcac81407 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:49.000988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922b472-db68-4af6-9bcd-3addcac81407 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:49.034447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a12e-ecd3-4748-8604-3b53ca0e549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:49.035194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a12e-ecd3-4748-8604-3b53ca0e549c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:49.035481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a12e-ecd3-4748-8604-3b53ca0e549c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:49.035760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a12e-ecd3-4748-8604-3b53ca0e549c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:49.036928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a12e-ecd3-4748-8604-3b53ca0e549c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:49.038346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a12e-ecd3-4748-8604-3b53ca0e549c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:49.040143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 501/1016] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:49.046171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:49.144501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69b45-d3f3-49ed-a47e-8394dc1b52dc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:49.178292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8d615-ce71-4dfe-ae31-5bddf917f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:49.178999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d615-ce71-4dfe-ae31-5bddf917f104 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:49.179254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d615-ce71-4dfe-ae31-5bddf917f104 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:49.179594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d615-ce71-4dfe-ae31-5bddf917f104 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:49.180313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8d615-ce71-4dfe-ae31-5bddf917f104 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:49.181800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8d615-ce71-4dfe-ae31-5bddf917f104 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:49.274619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 516/1017] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:49 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:49.640208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbf07-456b-445f-b50a-db5dab205694 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:49.640543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbf07-456b-445f-b50a-db5dab205694 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:49.640784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbf07-456b-445f-b50a-db5dab205694 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:49.642296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 502/1018] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:49.647558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3774-3a14-4745-987a-9a45dee5643f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:49.647854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3774-3a14-4745-987a-9a45dee5643f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:49.648135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3774-3a14-4745-987a-9a45dee5643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:49.665512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d8cf3774-3a14-4745-987a-9a45dee5643f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:49.667098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d8cf3774-3a14-4745-987a-9a45dee5643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:49.669467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:49.736072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 517/1019] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:49.759362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbf07-456b-445f-b50a-db5dab205694 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:49.785264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:49.867808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbf07-456b-445f-b50a-db5dab205694 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:49.904986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e9801-6b3b-4ced-bf10-b744bf8f78a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:49.905584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e9801-6b3b-4ced-bf10-b744bf8f78a1 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:49.905895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e9801-6b3b-4ced-bf10-b744bf8f78a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:49.906174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e9801-6b3b-4ced-bf10-b744bf8f78a1 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:49.906947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e9801-6b3b-4ced-bf10-b744bf8f78a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:49.908293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e9801-6b3b-4ced-bf10-b744bf8f78a1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:50.006404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 503/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:38:49 2022] POST /identity/v3/services => generated 242 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:38:50.598335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59369-f5ae-4c08-af6d-4e8f10c875d3 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:50.598888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59369-f5ae-4c08-af6d-4e8f10c875d3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:50.598888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b59369-f5ae-4c08-af6d-4e8f10c875d3 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:50.600420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 518/1021] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:50.605382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:50.605678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:50.605959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:50.623277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:50.624563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:50.696419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 504/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:50.720100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59369-f5ae-4c08-af6d-4e8f10c875d3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:50.817062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b59369-f5ae-4c08-af6d-4e8f10c875d3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:50.851265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:50.851994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:50.852469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:50.852571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:50.860866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:50.864753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:50.873063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:50.873994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:50.881921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 519/1023] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jun 16 11:38:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:50.884881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:50.893807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:50.987497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddff4-a677-4273-9418-26e77ff521a7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.021363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.022022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.022369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.022675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.023410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:51.023708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.025050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.033239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 505/1024] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:38:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:51.038548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.142699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883c89a-1f50-4b73-a555-c0ebd3718384 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.179903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.180699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.180982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.181262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.193051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.194523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:51.214340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:51.215364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:51.216269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:51.216269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:51.216269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:51.216269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:51.216269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 520/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:51.225877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.292833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:51.326281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55389a-8e93-42d5-8adc-f3f42eda4832 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.359436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.360094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.360376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.360648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.361363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:51.361667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.363050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e0303-eb5f-4209-8120-48d39bae2c63 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.375503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 506/1026] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:51.381009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.434269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:51.453285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288172-c2c7-445f-8cf1-33ee5cdc6ad0 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.453575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288172-c2c7-445f-8cf1-33ee5cdc6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.453854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288172-c2c7-445f-8cf1-33ee5cdc6ad0 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.455368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 507/1027] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:51.460231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.460642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.460923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.477061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:51.478244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:51.492623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88e4e5-28f9-4688-bfd0-c04e9e730f82 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.528951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.529937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.530220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.530548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.539126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.540794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.550195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 508/1028] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:51.557024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:51.557973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:51.558976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 521/1029] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:38:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:51.564690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.577295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.630434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:51.673296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b3c6-adaf-4fe4-8311-70d877cfa53a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.685391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac76d8e-5477-4248-a810-20c7738eebbd None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.696437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:51.709929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.710651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.710910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.711184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.712067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:51.712383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.713821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.720450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.721245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.721530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.721808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.723087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.725954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.728235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 522/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:51.736894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 509/1031] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:38:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:51.737039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.738720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:51.843562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc8db-0132-409f-b919-4901ee02ca75 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.846618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2477-22c7-4ece-b2b9-854bc9a5b379 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:51.863831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:51.881827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2984f-d391-47e8-8404-7c03ef32144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.882955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2984f-d391-47e8-8404-7c03ef32144c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.883461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2984f-d391-47e8-8404-7c03ef32144c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.883948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2984f-d391-47e8-8404-7c03ef32144c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.887355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:51.888158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:51.888441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:51.888865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:51.889591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.891049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:51.952389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2984f-d391-47e8-8404-7c03ef32144c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:51.953731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2984f-d391-47e8-8404-7c03ef32144c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.000811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 523/1032] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:38:51 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:52.068266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 510/1033] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:52.073951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.118776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.167254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e103-ccd9-4e4f-8a0c-b55da69c8eb5 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.167689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e103-ccd9-4e4f-8a0c-b55da69c8eb5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.167835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e103-ccd9-4e4f-8a0c-b55da69c8eb5 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.169311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 511/1034] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:52.174477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.174798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.175090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.193059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be3c0-3485-440b-8675-42d4ace35597 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.194740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:52.195592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:52.210686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.233691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.234853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.235145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.236251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.249684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.251212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:52.269341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:52.270457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:52.271572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:52.271572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:52.271572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:52.271572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:52.271572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 524/1035] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:52.276046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.276420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 512/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:52.299277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.367186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.384476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97eb96-0890-4ff3-84d6-751112d05658 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.406198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56eb62-a22f-430e-b9e9-add41b933ab0 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.423034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.423698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.423985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.424263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.425056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:52.425368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.426946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.440416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 525/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:52.441340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.442131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.442413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.442718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.443371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.444721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.445779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:52.456917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:52.458156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:52.459065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 513/1038] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:52.464984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.477795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.559570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254285cf-9b2b-4779-827b-05162e58d17f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.571320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5080c8-ca20-4794-a366-938eedd562b7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.596064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.596894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.597179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.597459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.604678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.606129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.608370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.609104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.609455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.609800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.610576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:52.610976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.612384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.617672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 514/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:52.620290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:52.624535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:52.625449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 526/1040] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:52.626025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.627679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.638482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.714329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.737481 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b2410-f15d-4db2-89d4-e4ee210eeff1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.742427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c6d02-be25-4ffc-98af-95c99c9116f3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.772945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.773697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.773917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.774160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.775047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:52.775293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.776760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.779981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.780636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.780921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.781199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.781901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] RBAC: Adding query filter params (type=image) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:52.782207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.783575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.788701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 515/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:52.790636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 527/1042] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:52.795757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.795888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.867645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:52.906955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022b0a6-e15c-41ef-89dc-319b18d79a68 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.908649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248793-fea0-43ba-a376-9bd7be009ff6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:52.944072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.944806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.945096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.945372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.946154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] RBAC: Adding query filter params (interface=public, service_id=0a1eda9929ac4ca293d5777d110cfc45, region_id=RegionOne) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:52.946464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.947847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.948378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:52.949023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:52.949308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:52.949571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:52.950385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] RBAC: Adding query filter params (role.id=c87e6081b4ce49d7ba604fb9b1e2be49, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=3ad599a6997f44dbb42472277cba7bc0) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:52.950722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:52.952653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222254-e5ff-4a18-9a45-a9368afe208a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:52.953664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 516/1043] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/endpoints?service_id=0a1eda9929ac4ca293d5777d110cfc45&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:52.967608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 528/1044] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/role_assignments?user.id=3ad599a6997f44dbb42472277cba7bc0&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=c87e6081b4ce49d7ba604fb9b1e2be49 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:52.967848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:52.967848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:53.072426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d93633-99d5-4794-b284-889dc0c68db1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:53.109942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248be3-4607-4a8d-a7c7-87c562070342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:53.111751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248be3-4607-4a8d-a7c7-87c562070342 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:53.111932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248be3-4607-4a8d-a7c7-87c562070342 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:53.112180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248be3-4607-4a8d-a7c7-87c562070342 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:53.113081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3248be3-4607-4a8d-a7c7-87c562070342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:53.114743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3248be3-4607-4a8d-a7c7-87c562070342 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:53.122616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 517/1045] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:38:52 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:38:54.191115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd066713-a443-429a-8bbf-9ef5cabd2d16 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:54.191625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd066713-a443-429a-8bbf-9ef5cabd2d16 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:54.191625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd066713-a443-429a-8bbf-9ef5cabd2d16 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:54.193002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 529/1046] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:54.199121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:54.199656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:54.199656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:54.216172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:54.217866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:54.276974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:54.285229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 518/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:54.308707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd066713-a443-429a-8bbf-9ef5cabd2d16 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:54.411894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd066713-a443-429a-8bbf-9ef5cabd2d16 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:54.439266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:54.445302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:54.446029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:54.446312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:54.446610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:54.457070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:54.464922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:54.465857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:54.472118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 530/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:54.475136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:54.572928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27bb2-2b1d-4353-b20b-4f6acba39299 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:54.607090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:54.607809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:54.608086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:54.608361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:54.609177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:54.609481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:54.610852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:54.619255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 519/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:54.624996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:54.725059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc626b-d890-43e7-acff-c71419f83856 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:54.757967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5049fd-9fba-4344-a34b-4469db3136fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:54.758857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5049fd-9fba-4344-a34b-4469db3136fd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:54.759137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5049fd-9fba-4344-a34b-4469db3136fd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:54.759408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5049fd-9fba-4344-a34b-4469db3136fd None admin] PATH_INFO: `/v3/users/145c4262b1fc4adf9d7e0086c67cac1e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:54.773489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5049fd-9fba-4344-a34b-4469db3136fd None admin] RBAC: Authorizing `identity:get_user(user_id=145c4262b1fc4adf9d7e0086c67cac1e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:54.774962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5049fd-9fba-4344-a34b-4469db3136fd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:54.776790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 531/1050] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:38:54 2022] GET /identity/v3/users/145c4262b1fc4adf9d7e0086c67cac1e => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:54.782536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:54.843157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:54.894537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a306-f653-48a4-bfcb-862514d6d70b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:54.928518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:54.929164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:54.929445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:54.929718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:54.997692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:54.999624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.060307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.092986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71b05-3624-411c-988f-e46ce9b9c349 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.093377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71b05-3624-411c-988f-e46ce9b9c349 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.093690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71b05-3624-411c-988f-e46ce9b9c349 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.095251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 532/1051] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:55.100084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.100373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.100647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.113002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 520/1052] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:55.118640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.120250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:55.122504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:55.175808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.203085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 533/1053] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:55.225320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.234918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db2aaa-b28d-4121-9b19-37f635e0df5b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.268725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50d7c3-4047-497b-930b-18480cde67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.269574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d7c3-4047-497b-930b-18480cde67c0 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.269850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d7c3-4047-497b-930b-18480cde67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.270217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d7c3-4047-497b-930b-18480cde67c0 None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.271413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50d7c3-4047-497b-930b-18480cde67c0 None admin] RBAC: Authorizing `identity:get_project(project_id=2da791e378ec4d3b8ae9d3a83af22905)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.272819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50d7c3-4047-497b-930b-18480cde67c0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.279408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 521/1054] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:55.279408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158321a7-879a-45ab-9767-0df1e3b157f6 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.279408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158321a7-879a-45ab-9767-0df1e3b157f6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.279408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158321a7-879a-45ab-9767-0df1e3b157f6 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.279408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 522/1055] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:55.280323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158321a7-879a-45ab-9767-0df1e3b157f6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.306709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.328748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4dfc5-2f1b-4b43-bb77-383c4755cf9b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.361139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf26db6-361b-4aef-9cc4-5bbe0a6f04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.361933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf26db6-361b-4aef-9cc4-5bbe0a6f04a7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.362212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf26db6-361b-4aef-9cc4-5bbe0a6f04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.362483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf26db6-361b-4aef-9cc4-5bbe0a6f04a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.372182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf26db6-361b-4aef-9cc4-5bbe0a6f04a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:55.379711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158321a7-879a-45ab-9767-0df1e3b157f6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7bf26db6-361b-4aef-9cc4-5bbe0a6f04a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:55.380827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:55.381989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:55.382888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 534/1056] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:55.383591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.383591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.383714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.399394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:55.400575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:55.416828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.417471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.417762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.418036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.418900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=2da791e378ec4d3b8ae9d3a83af22905, user.id=145c4262b1fc4adf9d7e0086c67cac1e) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:55.419213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.421253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.426786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 523/1057] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/role_assignments?user.id=145c4262b1fc4adf9d7e0086c67cac1e&scope.project.id=2da791e378ec4d3b8ae9d3a83af22905&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:55.427376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.443322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.485461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 535/1058] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:55.508910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.528092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.539575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84f54-560a-4cb4-8f3b-8a1a42c07339 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.579273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.580304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.580796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.581254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.582222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:55.582530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.583940 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.594692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 524/1059] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:55.610992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.620515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520c69-5cc4-4bf9-ba21-b37ed94de867 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.656136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.656839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.657123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.657393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] PATH_INFO: `/v3/services/image` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.658046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.659437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:55.672163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:55.673223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:55.674077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 536/1060] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:55.679433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.711213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.720395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc592b-75e9-4628-b722-42957d430a38 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.757617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.758413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.758854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.759272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.771388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.772926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.783059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669a3b0-1ef8-4dce-b71e-145ab2be64de None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:55.792066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:55.792954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:55.794073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:55.794073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:55.794073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:55.794073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:55.794073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 525/1061] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:55.799297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.802883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.819106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.819770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.820055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.820334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.821044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] RBAC: Adding query filter params (name=image) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:55.821355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.822781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.828457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 537/1062] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:55.834083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.909669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e46abc-90bb-42de-aca3-f05f1c5d17a9 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.942379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.943068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.943345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.943623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.944342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:55.944647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.945989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:55.948174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:55.955292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ed43-59b7-4ff2-ad1a-999478658ab5 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:55.958822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 526/1063] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:55.964082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:55.990908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:55.991834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:55.992543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:55.992830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:55.993697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] RBAC: Adding query filter params (type=image) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:55.994009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:55.995618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.005958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 538/1064] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:56.006920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:56.028344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:56.068310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b393-5f9b-46e3-8fa9-2f45e8b03e1c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.107928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.108731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.109173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.109454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.112452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb6a2-e944-4b49-a109-9cfea9f33a56 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.117749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.119409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:38:56.134506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:56.136146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:56.137338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 527/1065] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:38:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:56.143692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:56.153193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.153853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.154136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.155057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.155790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.157238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.206648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 539/1066] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:38:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:38:56.251961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb38a4-aef9-4bef-93e0-be4caacbbc0e None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.278762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:56.296766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.297444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.297723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.297996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.298873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:56.299180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.300625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.321134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 528/1067] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:38:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:56.327129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:56.346675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:56.434669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d17343-20f0-44de-8871-f46900b2d227 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.469479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.470260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.470540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.470849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.481370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.483065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:56.501014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:56.502194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:56.503369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:56.503369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:56.503369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:56.503369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:56.503369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 540/1068] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:56.509088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:56.610673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51a0e3-92a9-4591-8310-9a2a1ca53f4d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.644704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.645362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.645642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.645914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.646649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:56.646992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.648304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.663987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 529/1069] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:56.665605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:56.732026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:56.766199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29de286-b990-4e20-a474-7b9d553d0f7f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.799081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.799991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.800370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.800737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.807284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.808821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:38:56.823571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:56.824627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:38:56.825743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:38:56.827409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 541/1070] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:56.832830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:56.885559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:56.943794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763d238-1d47-4e19-8f29-fbe717d502e5 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:56.979154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:56.979806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:56.980086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:56.980361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:56.981133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:56.981438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:56.983487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da037e-7fc4-4cf9-8ad0-f1b711dee670 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:56.996524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 530/1071] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:57.002158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:57.101864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fea48-0654-4845-810e-627f26ccffb4 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:57.128084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:57.137247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ee0a-df9b-4daf-8863-02c27b385556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:57.137247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ee0a-df9b-4daf-8863-02c27b385556 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:57.137468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ee0a-df9b-4daf-8863-02c27b385556 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:57.137685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ee0a-df9b-4daf-8863-02c27b385556 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/3ad599a6997f44dbb42472277cba7bc0/roles/c87e6081b4ce49d7ba604fb9b1e2be49` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:57.140336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ee0a-df9b-4daf-8863-02c27b385556 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=3ad599a6997f44dbb42472277cba7bc0, role_id=c87e6081b4ce49d7ba604fb9b1e2be49)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:57.141762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ee0a-df9b-4daf-8863-02c27b385556 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:57.187464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 542/1072] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:57 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/3ad599a6997f44dbb42472277cba7bc0/roles/c87e6081b4ce49d7ba604fb9b1e2be49 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:57.547390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96230-342d-4e04-a77f-c0a227e2e621 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:57.547931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96230-342d-4e04-a77f-c0a227e2e621 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:57.547931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96230-342d-4e04-a77f-c0a227e2e621 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:57.549460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 531/1073] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:57.554447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:57.554865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:57.555059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:57.572120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:57.573307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:57.640200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 543/1074] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:57.662863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf96230-342d-4e04-a77f-c0a227e2e621 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:57.759304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:57.764631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf96230-342d-4e04-a77f-c0a227e2e621 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:57.799257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:57.799966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:57.800247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:57.800519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:57.810686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:57.818599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:57.819533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:38:57.820371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:57.821795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 532/1075] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:57.825853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:57.945377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bb0ee-dfa4-4ed0-b587-4aeb116499a2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:57.963681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:57.980994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:57.981666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:57.982023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:57.982876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:57.983642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:57.983955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:57.985329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:57.999092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 544/1076] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:58.000504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:58.101995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba63a2d-c767-4d58-8b8d-4fc6a70fd008 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:58.134526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:58.135422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:58.135706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:58.135980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] PATH_INFO: `/v3/users/145c4262b1fc4adf9d7e0086c67cac1e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:58.137163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] RBAC: Authorizing `identity:get_user(user_id=145c4262b1fc4adf9d7e0086c67cac1e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:58.140407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:58.142853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 533/1077] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:38:57 2022] GET /identity/v3/users/145c4262b1fc4adf9d7e0086c67cac1e => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:58.151444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:58.273552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24437476-da5d-472f-addb-0ed815de5a9e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:58.315415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a4f42-b9da-4fa2-ad65-5a732cf4e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:58.316292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a4f42-b9da-4fa2-ad65-5a732cf4e04d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:58.316570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a4f42-b9da-4fa2-ad65-5a732cf4e04d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:58.316843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a4f42-b9da-4fa2-ad65-5a732cf4e04d None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:58.318103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a4f42-b9da-4fa2-ad65-5a732cf4e04d None admin] RBAC: Authorizing `identity:get_project(project_id=2da791e378ec4d3b8ae9d3a83af22905)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:58.319606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a4f42-b9da-4fa2-ad65-5a732cf4e04d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:58.321652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 545/1078] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:38:58 2022] GET /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:58.328071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:58.359058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:58.395578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3038-ea41-4d67-a8e9-3d3da607d91c None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:58.395925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3038-ea41-4d67-a8e9-3d3da607d91c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:58.396256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3038-ea41-4d67-a8e9-3d3da607d91c None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:58.398370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 546/1079] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:38:58.403395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:58.403693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:58.403970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:58.421315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:58.422627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:58.431726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174559d-e8f9-40ce-90ae-8382689a3e78 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:58.468520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:58.468958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:58.470129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:58.470482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:58.470709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905/users/145c4262b1fc4adf9d7e0086c67cac1e/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:58.472706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2da791e378ec4d3b8ae9d3a83af22905, user_id=145c4262b1fc4adf9d7e0086c67cac1e, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:58.474121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:58.491821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 547/1080] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:38:58.514406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:58.558969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 534/1081] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:38:58 2022] PUT /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905/users/145c4262b1fc4adf9d7e0086c67cac1e/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:38:58.633465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7057-f7cd-4bfc-a16a-63d1b9fb1ecd None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:58.671400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:58.672204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:58.672515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:58.672760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:58.724360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:58.747471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:58.748934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:58.853981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 548/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:38:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:38:58.855663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:58.948979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:58.963816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fadbd-64ac-4a5a-8f29-209fcede13d0 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:58.999347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:59.000140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.000421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.000693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.012151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:59.014109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-040efcb2-3f50-436a-b347-72880c8e674e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:59.031587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:59.032526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:59.033423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:59.033423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:59.033423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:59.033423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:59.033423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 535/1083] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:59.038819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:59.115982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:59.137813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0ede-2915-486e-924c-00ef028aa72e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:59.172503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:59.173165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.173489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.173721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.174442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:59.174780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:59.176161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df958f-386a-4a04-bccf-240f27528d92 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:59.194639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 549/1084] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:38:59.334058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fa1a3-0f2b-4817-9d77-006e759de7f5 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.334389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fa1a3-0f2b-4817-9d77-006e759de7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.334650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fa1a3-0f2b-4817-9d77-006e759de7f5 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.336193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 536/1085] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:38:59.341710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.341993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.342280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.360501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:38:59.361743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:38:59.430140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 550/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:38:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:38:59.454573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fa1a3-0f2b-4817-9d77-006e759de7f5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:59.568234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fa1a3-0f2b-4817-9d77-006e759de7f5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:59.600312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:59.601111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.601394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.601669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.608850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:59.613507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:38:59.621588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:59.623584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:59.624443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 537/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jun 16 11:38:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:38:59.629559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:59.696279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:38:59.727911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba448859-dc63-4a94-a2ec-836887873c39 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:59.762965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:59.763668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.763949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.764222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.764969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:38:59.765274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:59.766652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:59.774440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 551/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:38:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:38:59.780783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:38:59.887247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152be5-7654-415d-8410-71c03d1e7495 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:38:59.919674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:38:59.920993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:38:59.921269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:38:59.921537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:38:59.931126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:38:59.932543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:38:59.949560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:38:59.950824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:38:59.952214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:38:59.952214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:38:59.952214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:38:59.952214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:38:59.952214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 538/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:38:59.956345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.057256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d0d84-8718-4975-b9fe-c777f16d75b1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:00.084557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:00.090257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:00.091289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.091289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.091517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.092720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:00.093026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:00.094394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:00.105964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 552/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:00.115391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.166736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:00.215488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ca55a-5465-4095-b1df-1da89e44d8ce None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:00.248601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:00.249383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.249663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.249934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.256761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:00.258175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:39:00.272667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:00.273792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 11:39:00.275111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:00.278535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 539/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:00.280173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.377198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493842b-c4b5-41e6-b673-8eb5d46ca7f8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:00.414860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:00.415269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.415555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.415833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.416668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:00.416976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:00.418398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198fdb-bda8-419c-9412-f21ce7ac3ea7 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:00.436005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 553/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:00.441867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.537466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9f55-4f28-4813-b6d5-f02801c796eb None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:00.548333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:00.571447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:00.572088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.572369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.572644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.642549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:00.644086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:00.671582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c087c-6a5e-4c05-b7f2-fd3da7651c2e None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.671865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c087c-6a5e-4c05-b7f2-fd3da7651c2e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.672137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c087c-6a5e-4c05-b7f2-fd3da7651c2e None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.673512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 554/1093] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:39:00.678156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.678442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.678750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.694819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:00.695989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:00.738970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:00.740610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 540/1094] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:00.746229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.757254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:00.760985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 555/1095] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:39:00.783946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.845082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402232e5-de5e-47d6-a933-a2ab9fac4fd3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:00.879464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:00.880256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.880536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.880810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.881043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ed00-fc53-4248-b63e-1a3d2bc4df1e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:00.890819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:00.892250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:39:00.909694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:00.910690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:00.911595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:39:00.911595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:39:00.911595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:39:00.911595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:00.911595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 541/1096] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:39:00.914615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:00.915405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:00.915685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:00.915957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:00.916371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.927859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:00.935436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:00.936546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:00.937480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:39:00.941638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 556/1097] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:39:00.942434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:00.977296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:00.981969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.015734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e191c-c4fd-42b5-9765-83cb59358287 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.042825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1552f-b3e7-44e0-a17f-07edb7ebb525 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.049888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.050538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.050849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.051406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.051829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:01.052137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.053489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.064571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 542/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:01.070863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.075908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.077112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.077394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.077668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.078415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:01.078758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.080116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.089477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 557/1099] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:01.095682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.170444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b8cd-ca81-4f8c-a687-ead979bbcc22 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.186569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.189669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87da5-7ca9-4ff3-8384-162f78b81a5f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.192729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.204361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.205152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.205437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.205712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.212250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.213757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.222846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.223702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.223981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.224251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] PATH_INFO: `/v3/users/145c4262b1fc4adf9d7e0086c67cac1e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.225438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] RBAC: Authorizing `identity:get_user(user_id=145c4262b1fc4adf9d7e0086c67cac1e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.226880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:39:01.228438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:01.229283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:39:01.230192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:01.230665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 558/1100] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/users/145c4262b1fc4adf9d7e0086c67cac1e => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:39:01.230736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 543/1101] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:01.234058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.235310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.330273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d996bb-0e53-470c-ac34-56bdcc80b6d2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.330494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5909-afae-4946-a63e-65adbdf57524 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.363591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.364013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.364164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.364445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.364656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.364757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.364942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.365220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.365472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:01.365777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.367216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.379326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 544/1102] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:39:01.385145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.398867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.427609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.432641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.434112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.483872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec621739-85a1-4ec9-a068-a08d67cfb754 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.517102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.517748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.518032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.518307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.519548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] RBAC: Adding query filter params (role.id=c87e6081b4ce49d7ba604fb9b1e2be49, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=3ad599a6997f44dbb42472277cba7bc0) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:01.519548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.520882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.526676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 545/1103] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/role_assignments?user.id=3ad599a6997f44dbb42472277cba7bc0&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=c87e6081b4ce49d7ba604fb9b1e2be49 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:39:01.531327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 559/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:01.537375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.643724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ed070-1574-42da-ba6e-6b6fcc2a0eb1 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.651148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.678852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921956e-08b5-41db-876a-79457292a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.679712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921956e-08b5-41db-876a-79457292a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.679995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921956e-08b5-41db-876a-79457292a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.680269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921956e-08b5-41db-876a-79457292a8e2 None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.681451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921956e-08b5-41db-876a-79457292a8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2da791e378ec4d3b8ae9d3a83af22905)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.682885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921956e-08b5-41db-876a-79457292a8e2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.684568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 546/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:01.691469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:01.758361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:01.791692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a486-f21a-4f93-b868-8141c274441b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:01.828001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:01.828648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:01.828925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:01.829197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:01.830017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=2da791e378ec4d3b8ae9d3a83af22905, user.id=145c4262b1fc4adf9d7e0086c67cac1e) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:01.830326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:01.831797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5f3c9-58f9-4220-aa2f-f4efc6f88a98 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:01.837538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 560/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:01 2022] GET /identity/v3/role_assignments?user.id=145c4262b1fc4adf9d7e0086c67cac1e&scope.project.id=2da791e378ec4d3b8ae9d3a83af22905&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:03.975706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f025-ee29-4ef9-9e85-b7b80e79d7dc None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:03.976223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f025-ee29-4ef9-9e85-b7b80e79d7dc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:03.976310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f025-ee29-4ef9-9e85-b7b80e79d7dc None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:03.977617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 547/1107] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:03.982888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:03.983285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:03.983449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:04.000120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:04.001305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:04.064900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 561/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:04.089090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f025-ee29-4ef9-9e85-b7b80e79d7dc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:04.186170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f025-ee29-4ef9-9e85-b7b80e79d7dc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:04.218800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f5ed4-1172-44f5-ba00-2cdecaea7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:04.219573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f5ed4-1172-44f5-ba00-2cdecaea7011 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:04.219855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f5ed4-1172-44f5-ba00-2cdecaea7011 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:04.220127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f5ed4-1172-44f5-ba00-2cdecaea7011 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:04.221280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f5ed4-1172-44f5-ba00-2cdecaea7011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:04.222714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f5ed4-1172-44f5-ba00-2cdecaea7011 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:04.224301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 548/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:04.229895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:04.288673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:04.324056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e5a17-300f-4624-93cd-db7d235aff17 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:04.357045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c8ed5-d640-4c80-bb1c-811730e0ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:04.357735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c8ed5-d640-4c80-bb1c-811730e0ebf5 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:04.358016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c8ed5-d640-4c80-bb1c-811730e0ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:04.358292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c8ed5-d640-4c80-bb1c-811730e0ebf5 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:04.359034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c8ed5-d640-4c80-bb1c-811730e0ebf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:04.360438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c8ed5-d640-4c80-bb1c-811730e0ebf5 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:04.444535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 562/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:39:04 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:39:06.579919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b90f-6eda-4b79-b89c-429a1cf963fd None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:06.580551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b90f-6eda-4b79-b89c-429a1cf963fd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:06.580551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b90f-6eda-4b79-b89c-429a1cf963fd None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:06.581804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 549/1111] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:06.587429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:06.607779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:06.607779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:06.607779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:06.607779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:06.672378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 563/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:39:06.696083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b90f-6eda-4b79-b89c-429a1cf963fd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:06.739237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:06.793328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b90f-6eda-4b79-b89c-429a1cf963fd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:06.825268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:06.826133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:06.826415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:06.826719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] PATH_INFO: `/v3/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:06.828157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] RBAC: Authorizing `identity:get_role(role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:06.829504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:06.830923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 550/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:06 2022] GET /identity/v3/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:06.836572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:06.883949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:06.935085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba98ccc-15df-4a87-85d0-ccf5840d131d None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:06.967727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:06.968592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:06.968875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:06.969151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] PATH_INFO: `/v3/users/5e6226dcc1c74a1b9f415017f2732ed6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:06.981574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] RBAC: Authorizing `identity:get_user(user_id=5e6226dcc1c74a1b9f415017f2732ed6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:06.983633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:06.985278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 564/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:06 2022] GET /identity/v3/users/5e6226dcc1c74a1b9f415017f2732ed6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:06.991479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:07.088010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256440-e621-49e6-8715-20f2bb229dba None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:07.098305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:07.120894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:07.121520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:07.121802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:07.122075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:07.185576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:07.187020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:07.280097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 551/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:07.286069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:07.379739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c8d5-f564-4e55-af13-16291756b354 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:07.386559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:07.412426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3a725-72f1-4851-b3aa-14d657ec1f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:07.413268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3a725-72f1-4851-b3aa-14d657ec1f0d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:07.413550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3a725-72f1-4851-b3aa-14d657ec1f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:07.413826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3a725-72f1-4851-b3aa-14d657ec1f0d None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:07.415021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3a725-72f1-4851-b3aa-14d657ec1f0d None admin] RBAC: Authorizing `identity:get_project(project_id=2da791e378ec4d3b8ae9d3a83af22905)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:07.416747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3a725-72f1-4851-b3aa-14d657ec1f0d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:07.421805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 565/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:07 2022] GET /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:07.424423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:07.436023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:07.519547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17136e-18c3-4b05-89b1-042c16439c22 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:07.551823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:07.552452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:07.552734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:07.553008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:07.553827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] RBAC: Adding query filter params (role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=2da791e378ec4d3b8ae9d3a83af22905, user.id=5e6226dcc1c74a1b9f415017f2732ed6) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:07.554143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:07.555558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3fb98-d5c6-4e73-98a6-85fb1e3b67e7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:07.561317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 552/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:07 2022] GET /identity/v3/role_assignments?user.id=5e6226dcc1c74a1b9f415017f2732ed6&scope.project.id=2da791e378ec4d3b8ae9d3a83af22905&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:09.649181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376ce73-3168-4d63-b852-e6ae1681b83f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:09.649722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376ce73-3168-4d63-b852-e6ae1681b83f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:09.649722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376ce73-3168-4d63-b852-e6ae1681b83f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:09.651145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 566/1118] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:09.656808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:09.657232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:09.657367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:09.674135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:09.675350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:09.739658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 553/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:09.762214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376ce73-3168-4d63-b852-e6ae1681b83f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:09.858888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376ce73-3168-4d63-b852-e6ae1681b83f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:09.891429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:09.892278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:09.892561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:09.892835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] PATH_INFO: `/v3/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:09.894316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] RBAC: Authorizing `identity:get_role(role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:09.895720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:09.897091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 567/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:09 2022] GET /identity/v3/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:09.902999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:09.906473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:09.998963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde3f7-2db9-46b0-ada3-34145fe7715a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:10.041074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:10.041954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:10.042238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:10.042511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] PATH_INFO: `/v3/users/5e6226dcc1c74a1b9f415017f2732ed6` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:10.043889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] RBAC: Authorizing `identity:get_user(user_id=5e6226dcc1c74a1b9f415017f2732ed6)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:10.045859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:10.047579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 554/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:09 2022] GET /identity/v3/users/5e6226dcc1c74a1b9f415017f2732ed6 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:10.053265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:10.095227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:10.148873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87670-62d2-40f9-abda-c8088fddc01a None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:10.181687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62745143-8ffb-402c-9044-fffc8f3984bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:10.182473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62745143-8ffb-402c-9044-fffc8f3984bd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:10.182778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62745143-8ffb-402c-9044-fffc8f3984bd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:10.183054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62745143-8ffb-402c-9044-fffc8f3984bd None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:10.184207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62745143-8ffb-402c-9044-fffc8f3984bd None admin] RBAC: Authorizing `identity:get_project(project_id=2da791e378ec4d3b8ae9d3a83af22905)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:10.186244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62745143-8ffb-402c-9044-fffc8f3984bd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:10.187940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 568/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:10 2022] GET /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:10.193855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:10.260453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:10.287914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725daaa-7049-4de3-b9d0-a687a737b512 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:10.320876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6c58a-5c3c-426d-b949-099ab48439e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:10.321740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c58a-5c3c-426d-b949-099ab48439e0 None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:10.322013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c58a-5c3c-426d-b949-099ab48439e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:10.322280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c58a-5c3c-426d-b949-099ab48439e0 None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905/users/5e6226dcc1c74a1b9f415017f2732ed6/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:10.324451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c58a-5c3c-426d-b949-099ab48439e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2da791e378ec4d3b8ae9d3a83af22905, user_id=5e6226dcc1c74a1b9f415017f2732ed6, role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:10.325897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c58a-5c3c-426d-b949-099ab48439e0 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:10.375312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 555/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:39:10 2022] PUT /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905/users/5e6226dcc1c74a1b9f415017f2732ed6/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:39:12.456200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e41ff-ebf4-4323-9081-e1f250e49d28 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:12.456751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e41ff-ebf4-4323-9081-e1f250e49d28 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:12.456751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e41ff-ebf4-4323-9081-e1f250e49d28 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:12.459259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 569/1124] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:12.464481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:12.464869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:12.465033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:12.481664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:12.482936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:12.545776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 556/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 11:39:12.568858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e41ff-ebf4-4323-9081-e1f250e49d28 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:12.665803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e41ff-ebf4-4323-9081-e1f250e49d28 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:12.675902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:12.698304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:12.699176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:12.699459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:12.699733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] PATH_INFO: `/v3/roles/9b578298a15e41cd9badb3f2059d0ae2` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:12.701734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] RBAC: Authorizing `identity:get_role(role_id=9b578298a15e41cd9badb3f2059d0ae2)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:12.703129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:12.704471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 570/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:12 2022] GET /identity/v3/roles/9b578298a15e41cd9badb3f2059d0ae2 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:12.710045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:12.767554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:12.803275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706ed2d-5cdc-43dc-bb8d-fe97b41f3912 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:12.836388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:12.837252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:12.837535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:12.837807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] PATH_INFO: `/v3/users/5e6226dcc1c74a1b9f415017f2732ed6` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:12.839008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] RBAC: Authorizing `identity:get_user(user_id=5e6226dcc1c74a1b9f415017f2732ed6)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:12.840415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:12.842036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 557/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:12 2022] GET /identity/v3/users/5e6226dcc1c74a1b9f415017f2732ed6 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:12.847560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:12.942712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a225-9c42-4dbc-a473-46558e10f4bf None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:12.975089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:12.975668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:12.975951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:12.976229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:13.020887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:13.041101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:13.042532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:13.136876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 571/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 11:39:13.142938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:13.237800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744a91f-c1a7-4698-b370-c385246947df None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:13.265994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:13.275785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38bc7-bccf-4260-80fe-24f63d7d7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:13.276634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38bc7-bccf-4260-80fe-24f63d7d7f79 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:13.276920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38bc7-bccf-4260-80fe-24f63d7d7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:13.277194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38bc7-bccf-4260-80fe-24f63d7d7f79 None admin] PATH_INFO: `/v3/projects/2da791e378ec4d3b8ae9d3a83af22905` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:13.278366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38bc7-bccf-4260-80fe-24f63d7d7f79 None admin] RBAC: Authorizing `identity:get_project(project_id=2da791e378ec4d3b8ae9d3a83af22905)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:13.282281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38bc7-bccf-4260-80fe-24f63d7d7f79 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:13.284699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 558/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:13 2022] GET /identity/v3/projects/2da791e378ec4d3b8ae9d3a83af22905 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:13.290859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:13.364679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:13.385219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c685-eda0-4335-9df8-7c16bf862c9b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:13.418062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:13.418722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:13.419004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:13.419277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:13.420633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] RBAC: Adding query filter params (role.id=9b578298a15e41cd9badb3f2059d0ae2, scope.project.id=2da791e378ec4d3b8ae9d3a83af22905, user.id=5e6226dcc1c74a1b9f415017f2732ed6) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:13.420939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:13.422341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ce959-9ba7-4a08-83f4-cd0e00918517 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:13.427980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 572/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:13 2022] GET /identity/v3/role_assignments?user.id=5e6226dcc1c74a1b9f415017f2732ed6&scope.project.id=2da791e378ec4d3b8ae9d3a83af22905&role.id=9b578298a15e41cd9badb3f2059d0ae2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:15.579624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f4dcd-a454-483d-887e-61138bb91e0e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:15.580152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f4dcd-a454-483d-887e-61138bb91e0e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:15.580152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f4dcd-a454-483d-887e-61138bb91e0e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:15.581528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 559/1131] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:15.586786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:15.587180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:15.593238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:15.603643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:15.604978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:15.670227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 573/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:15.693358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f4dcd-a454-483d-887e-61138bb91e0e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:15.790458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f4dcd-a454-483d-887e-61138bb91e0e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:15.823222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee800c-4f2f-4737-8ed6-c2a4fade316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:15.823987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee800c-4f2f-4737-8ed6-c2a4fade316d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:15.824269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee800c-4f2f-4737-8ed6-c2a4fade316d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:15.824543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee800c-4f2f-4737-8ed6-c2a4fade316d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:15.825696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee800c-4f2f-4737-8ed6-c2a4fade316d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:15.827179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee800c-4f2f-4737-8ed6-c2a4fade316d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:15.828742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 560/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:15.834384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:15.902759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:15.931873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b068-0342-4568-8060-c1cf39c97349 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:15.964080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9733bf-8445-47a3-980d-86d212fbdd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:15.964729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9733bf-8445-47a3-980d-86d212fbdd68 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:15.965011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9733bf-8445-47a3-980d-86d212fbdd68 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:15.965287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9733bf-8445-47a3-980d-86d212fbdd68 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:15.965982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9733bf-8445-47a3-980d-86d212fbdd68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:15.967962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9733bf-8445-47a3-980d-86d212fbdd68 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:16.050144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 574/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:39:15 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:39:18.173177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab900e-7b62-40cf-a96a-933db41fbd46 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:18.173686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab900e-7b62-40cf-a96a-933db41fbd46 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:18.173686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab900e-7b62-40cf-a96a-933db41fbd46 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:18.175018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 561/1135] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:18.180050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:18.180492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:18.180613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:18.197647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:18.198860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:18.262324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 575/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:18.287333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab900e-7b62-40cf-a96a-933db41fbd46 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:18.350514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:18.383694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab900e-7b62-40cf-a96a-933db41fbd46 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:18.415715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db29b-8789-44f1-91cb-3bb55142f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:18.416485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db29b-8789-44f1-91cb-3bb55142f6e3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:18.416765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db29b-8789-44f1-91cb-3bb55142f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:18.417038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db29b-8789-44f1-91cb-3bb55142f6e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:18.418183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507db29b-8789-44f1-91cb-3bb55142f6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:18.420154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507db29b-8789-44f1-91cb-3bb55142f6e3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:18.421703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 562/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:39:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:18.427352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:18.479559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:18.524510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f698f-4733-4f36-92f0-92d6b79ddf70 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:18.556792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c01cb-c3f3-4fd7-96e4-7673af4f004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:18.557443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c01cb-c3f3-4fd7-96e4-7673af4f004a None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:18.557728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c01cb-c3f3-4fd7-96e4-7673af4f004a None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:18.558006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c01cb-c3f3-4fd7-96e4-7673af4f004a None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:18.558732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c01cb-c3f3-4fd7-96e4-7673af4f004a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:18.560707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c01cb-c3f3-4fd7-96e4-7673af4f004a None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:18.625764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 576/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:39:18 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:39:20.748201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d119b-6c4c-42c6-bbd1-51f6f75ec6f8 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:20.748735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d119b-6c4c-42c6-bbd1-51f6f75ec6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:20.748735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d119b-6c4c-42c6-bbd1-51f6f75ec6f8 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:20.750099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 563/1139] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:20.755109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:20.755503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:20.755664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:20.772309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:20.773478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:20.836711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 577/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:20.859914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d119b-6c4c-42c6-bbd1-51f6f75ec6f8 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:20.957759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d119b-6c4c-42c6-bbd1-51f6f75ec6f8 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:20.989283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:20.990058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:20.990341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:20.990640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:20.992434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:21.001167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:21.008663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:21.009807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:21.011095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 564/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:21.016354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:21.055328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:21.111625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48c86-734d-41eb-95b0-0d484268588b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:21.144818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:21.145468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:21.145751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:21.146025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:21.146792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:21.147097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:21.148456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:21.157924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 578/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:21.163658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:21.258516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb879207-ce2f-42ef-ab16-9726950dcc4f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:21.292382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:21.293244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:21.293526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:21.293798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] PATH_INFO: `/v3/users/fea946efb3c34e5ea31729c29c474f4d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:21.306976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] RBAC: Authorizing `identity:get_user(user_id=fea946efb3c34e5ea31729c29c474f4d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:21.308404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:21.310681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 565/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:21 2022] GET /identity/v3/users/fea946efb3c34e5ea31729c29c474f4d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:21.316690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:21.411620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80ee9-8873-4a97-aad1-35c30b9933f8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:21.413083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:21.444421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:21.445060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:21.445343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:21.445617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:21.510400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:21.511809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:21.606380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 579/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:21.612216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:21.662691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:21.707653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62812-ba5c-431d-99ff-ecbe7826887f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:21.739137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce072-d79b-4cb2-8384-1e35b1144dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:21.739974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce072-d79b-4cb2-8384-1e35b1144dff None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:21.740256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce072-d79b-4cb2-8384-1e35b1144dff None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:21.740529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce072-d79b-4cb2-8384-1e35b1144dff None admin] PATH_INFO: `/v3/projects/57b9178c1aaf4f31b8168fa519c13237` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:21.741686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce072-d79b-4cb2-8384-1e35b1144dff None admin] RBAC: Authorizing `identity:get_project(project_id=57b9178c1aaf4f31b8168fa519c13237)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:21.743128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce072-d79b-4cb2-8384-1e35b1144dff None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:21.744779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 566/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:21 2022] GET /identity/v3/projects/57b9178c1aaf4f31b8168fa519c13237 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:21.751368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:21.753494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:21.846913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314731-3bb2-432e-ad5b-41daf6e61690 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:21.897814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:21.898462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:21.898775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:21.899050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:21.899880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=57b9178c1aaf4f31b8168fa519c13237, user.id=fea946efb3c34e5ea31729c29c474f4d) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:21.900188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:21.901617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be2fe1-71d2-4079-86c5-9bfb44a09eca None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:21.907155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 580/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:21 2022] GET /identity/v3/role_assignments?user.id=fea946efb3c34e5ea31729c29c474f4d&scope.project.id=57b9178c1aaf4f31b8168fa519c13237&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:23.985957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676aa77-e528-4712-952b-1c6777635dbf None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:23.986500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676aa77-e528-4712-952b-1c6777635dbf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:23.986500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676aa77-e528-4712-952b-1c6777635dbf None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:23.987884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 567/1147] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:23.993183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:23.993571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:23.993732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:24.009779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:24.010978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:24.067473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:24.074478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 581/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:24.097308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676aa77-e528-4712-952b-1c6777635dbf None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:24.195464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676aa77-e528-4712-952b-1c6777635dbf None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:24.214523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:24.227470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:24.228245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:24.228523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:24.228794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:24.238354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:24.246119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:24.247182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:24.248531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 568/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:24.254009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:24.347804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be155f3-fcc5-4840-9866-36820b69132c None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:24.380874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:24.381527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:24.381808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:24.382081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:24.382846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:24.383152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:24.384549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:24.392340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 582/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:24.398215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:24.495184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d66cf-bb53-427c-a35b-bbb6258e080c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:24.530350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:24.531227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:24.531503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:24.531771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] PATH_INFO: `/v3/users/fea946efb3c34e5ea31729c29c474f4d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:24.532929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] RBAC: Authorizing `identity:get_user(user_id=fea946efb3c34e5ea31729c29c474f4d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:24.534339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:24.535962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 569/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:24 2022] GET /identity/v3/users/fea946efb3c34e5ea31729c29c474f4d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:24.541599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:24.598212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:24.637674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148cb8-bdf8-4c45-bcf0-e7fd9f67b677 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:24.670110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805ede-a80f-4e07-9afd-d0a058ac9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:24.670978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805ede-a80f-4e07-9afd-d0a058ac9736 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:24.671259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805ede-a80f-4e07-9afd-d0a058ac9736 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:24.671529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805ede-a80f-4e07-9afd-d0a058ac9736 None admin] PATH_INFO: `/v3/projects/57b9178c1aaf4f31b8168fa519c13237` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:24.672677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805ede-a80f-4e07-9afd-d0a058ac9736 None admin] RBAC: Authorizing `identity:get_project(project_id=57b9178c1aaf4f31b8168fa519c13237)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:24.674087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805ede-a80f-4e07-9afd-d0a058ac9736 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:24.675771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 583/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:24 2022] GET /identity/v3/projects/57b9178c1aaf4f31b8168fa519c13237 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:24.681469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:24.728555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:24.776828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf55a-f810-4518-942a-f54cb9341b8c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:24.807809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6cf41-ac50-498f-abcd-b07cf0a78f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:24.808667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cf41-ac50-498f-abcd-b07cf0a78f7f None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:24.808946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cf41-ac50-498f-abcd-b07cf0a78f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:24.809214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cf41-ac50-498f-abcd-b07cf0a78f7f None admin] PATH_INFO: `/v3/projects/57b9178c1aaf4f31b8168fa519c13237/users/fea946efb3c34e5ea31729c29c474f4d/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:24.811724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6cf41-ac50-498f-abcd-b07cf0a78f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=57b9178c1aaf4f31b8168fa519c13237, user_id=fea946efb3c34e5ea31729c29c474f4d, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:24.813113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6cf41-ac50-498f-abcd-b07cf0a78f7f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:24.917917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 570/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:39:24 2022] PUT /identity/v3/projects/57b9178c1aaf4f31b8168fa519c13237/users/fea946efb3c34e5ea31729c29c474f4d/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:39:26.994671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645aa8-1535-41c2-a7fa-1663b04f3267 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:26.995201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645aa8-1535-41c2-a7fa-1663b04f3267 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:26.995290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645aa8-1535-41c2-a7fa-1663b04f3267 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:26.996606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 584/1154] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:27.001783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:27.002145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:27.002341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:27.018684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:27.019865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:27.083623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 571/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:27.106632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7645aa8-1535-41c2-a7fa-1663b04f3267 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:27.207225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7645aa8-1535-41c2-a7fa-1663b04f3267 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:27.231170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:27.239468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:27.240243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:27.240524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:27.240795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:27.251483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:27.259115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:27.260251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:39:27.261408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 585/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:27.266901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:27.304286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:27.361996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564a47-8d7e-4301-a528-d0066950e7b5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:27.395233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:27.395882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:27.396166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:27.396445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:27.397180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:27.397488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:27.398868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:27.406640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 572/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:27.412420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:27.507502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071b75-ae5f-4771-ace8-f24e6714fe2b None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:27.539178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184446d1-e815-44b2-91b3-051525820035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:27.540027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184446d1-e815-44b2-91b3-051525820035 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:27.540307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184446d1-e815-44b2-91b3-051525820035 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:27.540580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184446d1-e815-44b2-91b3-051525820035 None admin] PATH_INFO: `/v3/users/fea946efb3c34e5ea31729c29c474f4d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:27.541755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184446d1-e815-44b2-91b3-051525820035 None admin] RBAC: Authorizing `identity:get_user(user_id=fea946efb3c34e5ea31729c29c474f4d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:27.543219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184446d1-e815-44b2-91b3-051525820035 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:27.545347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 586/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:27 2022] GET /identity/v3/users/fea946efb3c34e5ea31729c29c474f4d => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:39:27.550929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:27.644660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:27.647533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945aec0-7115-4dc3-b621-c22b6fcf65e3 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:27.681189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:27.681812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:27.682096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:27.682372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:27.746227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:27.747692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:27.836661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:27.840090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 573/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:27.846278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184446d1-e815-44b2-91b3-051525820035 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:27.901567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:27.945198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184446d1-e815-44b2-91b3-051525820035 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:27.977195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd809c-a9eb-469e-bfda-e7c4f985103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:27.978039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd809c-a9eb-469e-bfda-e7c4f985103b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:27.978315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd809c-a9eb-469e-bfda-e7c4f985103b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:27.978609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd809c-a9eb-469e-bfda-e7c4f985103b None admin] PATH_INFO: `/v3/projects/57b9178c1aaf4f31b8168fa519c13237` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:27.979760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd809c-a9eb-469e-bfda-e7c4f985103b None admin] RBAC: Authorizing `identity:get_project(project_id=57b9178c1aaf4f31b8168fa519c13237)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:27.981173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd809c-a9eb-469e-bfda-e7c4f985103b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:27.983445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 587/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:27 2022] GET /identity/v3/projects/57b9178c1aaf4f31b8168fa519c13237 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:27.989416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:28.083015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25a202-4f34-446b-956d-3e7cd95e6e47 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:28.114721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:28.115292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:28.115568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:28.115840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:28.116642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=57b9178c1aaf4f31b8168fa519c13237, user.id=fea946efb3c34e5ea31729c29c474f4d) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:28.116948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:28.118335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786eb6a-2f16-4b93-8f4d-b6f83311a9df None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:28.123944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 574/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:27 2022] GET /identity/v3/role_assignments?user.id=fea946efb3c34e5ea31729c29c474f4d&scope.project.id=57b9178c1aaf4f31b8168fa519c13237&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:30.283367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f34f7-d82a-42c6-9a23-755908d38cdc None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:30.283887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f34f7-d82a-42c6-9a23-755908d38cdc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:30.283999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f34f7-d82a-42c6-9a23-755908d38cdc None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:30.285284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 588/1162] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:30.290905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:30.291301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:30.291454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:30.308670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:30.309891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:30.367133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:30.375932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 575/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:30.398225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f34f7-d82a-42c6-9a23-755908d38cdc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:30.502841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f34f7-d82a-42c6-9a23-755908d38cdc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:30.526956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:30.538815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:30.538815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:30.539169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:30.539257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:30.613444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:30.614961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:30.726855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 589/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:30.732804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:30.830440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada643b3-eb1b-4e8a-aa50-f5d5aa9ac03e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:30.862771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:30.863568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:30.863845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:30.864113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:30.870705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:30.872183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-fcdf45c5-f55d-4717-9703-adfcc0b97620 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:30.886395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:30.887657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:30.889133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 576/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:39:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:30.894262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:30.917055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:30.989051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6040-e7fb-4aac-b04a-3bd08581dbeb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:31.023002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:31.023642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:31.023920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:31.024191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:31.024902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:31.025205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:31.026561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb3ca-3a38-4358-b79a-2c78a3bf92b8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:31.033614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 590/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jun 16 11:39:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:33.121611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72ed1e-3143-4534-ac97-f030a25cc90e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:33.122118 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72ed1e-3143-4534-ac97-f030a25cc90e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:33.122211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72ed1e-3143-4534-ac97-f030a25cc90e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:33.124153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 577/1167] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:33.129214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1beb-243a-490a-8000-7128ff9b7f07 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:33.129611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1beb-243a-490a-8000-7128ff9b7f07 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:33.129775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1beb-243a-490a-8000-7128ff9b7f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:33.146623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e3bb1beb-243a-490a-8000-7128ff9b7f07 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:33.147761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e3bb1beb-243a-490a-8000-7128ff9b7f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:33.213364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 591/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:33.235869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72ed1e-3143-4534-ac97-f030a25cc90e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:33.290463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:33.335524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72ed1e-3143-4534-ac97-f030a25cc90e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:33.367725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c9183-c95d-4c1b-ac69-01f43906bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:33.368368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c9183-c95d-4c1b-ac69-01f43906bde3 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:33.368656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c9183-c95d-4c1b-ac69-01f43906bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:33.368933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c9183-c95d-4c1b-ac69-01f43906bde3 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:33.369666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c9183-c95d-4c1b-ac69-01f43906bde3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:33.371083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c9183-c95d-4c1b-ac69-01f43906bde3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:33.461359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 578/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Thu Jun 16 11:39:33 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:39:35.575258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c197-2b33-4f5c-a140-a5ca0d01cbbd None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:35.576278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c197-2b33-4f5c-a140-a5ca0d01cbbd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:35.576371 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c197-2b33-4f5c-a140-a5ca0d01cbbd None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:35.577692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 592/1170] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:35.582860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:35.583298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:35.583428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:35.600336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:35.601515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:35.666282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 579/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:35.689375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c197-2b33-4f5c-a140-a5ca0d01cbbd None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:35.707590 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:35.787218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c197-2b33-4f5c-a140-a5ca0d01cbbd None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:35.819122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04d813-ae6b-4621-988f-b7d995de1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:35.819958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04d813-ae6b-4621-988f-b7d995de1d9b None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:35.820238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04d813-ae6b-4621-988f-b7d995de1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:35.820510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04d813-ae6b-4621-988f-b7d995de1d9b None admin] PATH_INFO: `/v3/domains/4e21ca5da21446228bb353cfaaa8283e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:35.831092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04d813-ae6b-4621-988f-b7d995de1d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e21ca5da21446228bb353cfaaa8283e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:35.832465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04d813-ae6b-4621-988f-b7d995de1d9b None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:35.834063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 593/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Jun 16 11:39:35 2022] GET /identity/v3/domains/4e21ca5da21446228bb353cfaaa8283e => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:35.839762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:35.883226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:35.935452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc194c-951e-476d-98db-7c7d962b1dac None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:35.967798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32e90b-5d7f-4317-b024-63b73963e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:35.968442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e90b-5d7f-4317-b024-63b73963e704 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:35.968724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e90b-5d7f-4317-b024-63b73963e704 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:35.968999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32e90b-5d7f-4317-b024-63b73963e704 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:35.969702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e90b-5d7f-4317-b024-63b73963e704 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:35.971151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32e90b-5d7f-4317-b024-63b73963e704 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:36.038438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 580/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:39:35 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:39:38.166514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a468f1-33f8-460b-bafd-f4ec1708063e None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:38.167093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a468f1-33f8-460b-bafd-f4ec1708063e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:38.167093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a468f1-33f8-460b-bafd-f4ec1708063e None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:38.168404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 594/1174] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:38.173458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:38.173847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:38.174019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:38.191054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:38.192232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:38.255463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 581/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:38.279645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a468f1-33f8-460b-bafd-f4ec1708063e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:38.359393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:38.383209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a468f1-33f8-460b-bafd-f4ec1708063e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:38.416050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efcc84-3435-4f53-bb83-8abc15a4fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:38.416943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efcc84-3435-4f53-bb83-8abc15a4fc7f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:38.417174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efcc84-3435-4f53-bb83-8abc15a4fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:38.417445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efcc84-3435-4f53-bb83-8abc15a4fc7f None admin] PATH_INFO: `/v3/domains/4e21ca5da21446228bb353cfaaa8283e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:38.418637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efcc84-3435-4f53-bb83-8abc15a4fc7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e21ca5da21446228bb353cfaaa8283e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:38.420088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efcc84-3435-4f53-bb83-8abc15a4fc7f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:38.421691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 595/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Jun 16 11:39:38 2022] GET /identity/v3/domains/4e21ca5da21446228bb353cfaaa8283e => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:38.427525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:38.454336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:38.523760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96121dd-dfce-4ffd-a9cb-9839b59b691d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:38.555929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536686-7249-4538-bc8f-c305b2ee1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:38.556579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536686-7249-4538-bc8f-c305b2ee1752 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:38.556862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536686-7249-4538-bc8f-c305b2ee1752 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:38.557136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536686-7249-4538-bc8f-c305b2ee1752 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:38.557841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536686-7249-4538-bc8f-c305b2ee1752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:38.559271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536686-7249-4538-bc8f-c305b2ee1752 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:38.614951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 582/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:39:38 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:39:40.758423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6e22-50a7-4913-a147-096f8ffbc29f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:40.759024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6e22-50a7-4913-a147-096f8ffbc29f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:40.759024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6e22-50a7-4913-a147-096f8ffbc29f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:40.760380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 596/1178] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:40.765967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:40.766346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:40.766523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:40.783286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:40.784469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:40.847384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 583/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:40.870154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c6e22-50a7-4913-a147-096f8ffbc29f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:40.967014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c6e22-50a7-4913-a147-096f8ffbc29f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:40.998145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:40.998942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:40.999223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:40.999495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:41.009461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:41.017503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:41.018691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:39:41.019972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 597/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:41.024535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:41.038808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:41.120542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9389b30-0ea8-49b0-835b-c83a74093844 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:41.152917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:41.154129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:41.154411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:41.154733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:41.155472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:41.155778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:41.157135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:41.164850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 584/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:41.170615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:41.174302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:41.267055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd96b-2dc1-4f05-ae55-b4848ed59db9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:41.298977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:41.299826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:41.300108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:41.300386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] PATH_INFO: `/v3/users/7c0102b0386443a98ff68a115f11c1a7` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:41.314231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7c0102b0386443a98ff68a115f11c1a7)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:41.315949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:41.317564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 598/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:41 2022] GET /identity/v3/users/7c0102b0386443a98ff68a115f11c1a7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:41.323264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:41.395722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:41.418520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16aa7-ef8f-4b63-a730-76f8b72b5ab2 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:41.452102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:41.452733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:41.453017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:41.453294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:41.517436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:41.518831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:41.591785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:41.620457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 585/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:41.627032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:41.685878 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:41.721963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3b46-ac40-42b5-aa05-2497afd483e8 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:41.754810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501b1c2-c33b-462e-a834-9f6aeb1f62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:41.755657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501b1c2-c33b-462e-a834-9f6aeb1f62be None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:41.755944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501b1c2-c33b-462e-a834-9f6aeb1f62be None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:41.756222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501b1c2-c33b-462e-a834-9f6aeb1f62be None admin] PATH_INFO: `/v3/projects/07fd022a754a4b53b46cb7ab14d40660` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:41.757391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501b1c2-c33b-462e-a834-9f6aeb1f62be None admin] RBAC: Authorizing `identity:get_project(project_id=07fd022a754a4b53b46cb7ab14d40660)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:41.758849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501b1c2-c33b-462e-a834-9f6aeb1f62be None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:41.760517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 599/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:41 2022] GET /identity/v3/projects/07fd022a754a4b53b46cb7ab14d40660 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:41.766457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:41.861042 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b70e89-4358-4cd7-8c9c-209b5fd1fa3d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:41.898981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:41.899629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:41.899918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:41.900192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:41.901014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=07fd022a754a4b53b46cb7ab14d40660, user.id=7c0102b0386443a98ff68a115f11c1a7) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:41.901324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:41.902777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92cf7-7480-47b7-84cf-6e6a5bdb8eda None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:41.908670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 586/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:41 2022] GET /identity/v3/role_assignments?user.id=7c0102b0386443a98ff68a115f11c1a7&scope.project.id=07fd022a754a4b53b46cb7ab14d40660&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:43.960958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9b1d-82ea-4447-a6e9-9a646d52e369 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:43.961478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9b1d-82ea-4447-a6e9-9a646d52e369 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:43.961478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9b1d-82ea-4447-a6e9-9a646d52e369 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:43.962890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 600/1186] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:43.968065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:43.968456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:43.968622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:43.985233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:43.986402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:44.014503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:44.049326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 587/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:44.072319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9b1d-82ea-4447-a6e9-9a646d52e369 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:44.169845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9b1d-82ea-4447-a6e9-9a646d52e369 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:44.197439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:44.204601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:44.208720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:44.208720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:44.208720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:44.218798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:44.227034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:44.228151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:39:44.229206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 601/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:44.234992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:44.329611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f365f3-db01-404d-a8ba-d14e49c0cfc5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:44.363873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:44.364657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:44.365156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:44.365653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:44.366470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:44.366805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:44.368164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:44.376586 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 588/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:44.382527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:44.477810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf40e-5f22-4fce-a14d-47cc1573f4df None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:44.509981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:44.510868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:44.511154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:44.511433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] PATH_INFO: `/v3/users/7c0102b0386443a98ff68a115f11c1a7` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:44.512612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] RBAC: Authorizing `identity:get_user(user_id=7c0102b0386443a98ff68a115f11c1a7)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:44.514545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:44.516180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 602/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:44 2022] GET /identity/v3/users/7c0102b0386443a98ff68a115f11c1a7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:44.521920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:44.552437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:44.619661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100669f-cd24-45f9-b32c-018069e1172d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:44.651955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff10c58-d449-42f5-a16c-dc13715e31ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:44.652800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff10c58-d449-42f5-a16c-dc13715e31ff None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:44.653079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff10c58-d449-42f5-a16c-dc13715e31ff None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:44.653369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff10c58-d449-42f5-a16c-dc13715e31ff None admin] PATH_INFO: `/v3/projects/07fd022a754a4b53b46cb7ab14d40660` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:44.655076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff10c58-d449-42f5-a16c-dc13715e31ff None admin] RBAC: Authorizing `identity:get_project(project_id=07fd022a754a4b53b46cb7ab14d40660)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:44.656481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff10c58-d449-42f5-a16c-dc13715e31ff None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:44.658145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 589/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:44 2022] GET /identity/v3/projects/07fd022a754a4b53b46cb7ab14d40660 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:44.664097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:44.720383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:44.759379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33effc22-15a1-438a-a91e-74dc13b67f12 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:44.791724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1603295-eba2-4b33-8777-9d157ecf8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:44.792588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1603295-eba2-4b33-8777-9d157ecf8d5f None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:44.792869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1603295-eba2-4b33-8777-9d157ecf8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:44.793141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1603295-eba2-4b33-8777-9d157ecf8d5f None admin] PATH_INFO: `/v3/projects/07fd022a754a4b53b46cb7ab14d40660/users/7c0102b0386443a98ff68a115f11c1a7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:44.795121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1603295-eba2-4b33-8777-9d157ecf8d5f None admin] RBAC: Authorizing `identity:create_grant(project_id=07fd022a754a4b53b46cb7ab14d40660, user_id=7c0102b0386443a98ff68a115f11c1a7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:44.796538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1603295-eba2-4b33-8777-9d157ecf8d5f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:44.878400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 603/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:39:44 2022] PUT /identity/v3/projects/07fd022a754a4b53b46cb7ab14d40660/users/7c0102b0386443a98ff68a115f11c1a7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:39:46.961806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3927-2b10-427b-b48b-3075f1a6e008 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:46.962322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3927-2b10-427b-b48b-3075f1a6e008 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:46.962518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3927-2b10-427b-b48b-3075f1a6e008 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:46.963744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 590/1193] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:39:46.968906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:46.969316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:46.969471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:46.986177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:39:46.987384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:39:47.051653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 604/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:39:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:39:47.076053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3927-2b10-427b-b48b-3075f1a6e008 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:47.171255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:47.175772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3927-2b10-427b-b48b-3075f1a6e008 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:47.207910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:47.208676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:47.208958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:47.209230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:47.219341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:39:47.226867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:39:47.227975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:39:47.228908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 591/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:39:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:39:47.234570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:47.280663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:47.329375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c942-6387-483a-9ee7-c88fcccec67a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:47.363074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:47.363725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:47.364006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:47.364283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:47.365026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:47.365330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:47.366720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:47.374405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 605/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:47.380162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:47.474541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb4e7e-cce2-4bde-ad4b-5c2c41fc0740 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:47.506504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:47.507395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:47.507679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:47.507954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] PATH_INFO: `/v3/users/7c0102b0386443a98ff68a115f11c1a7` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:47.509115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] RBAC: Authorizing `identity:get_user(user_id=7c0102b0386443a98ff68a115f11c1a7)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:47.510518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:47.512119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 592/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jun 16 11:39:47 2022] GET /identity/v3/users/7c0102b0386443a98ff68a115f11c1a7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:47.518209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:47.613152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3226-b987-437d-a20c-bf3cd8b5f64d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:47.622953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:47.645715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:47.646344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:47.646650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:47.646929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:47.711580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:47.713013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:47.805776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 606/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:39:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:39:47.811490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:47.838784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:47.908481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef89dc-dc44-4360-a6ee-7248d2312b23 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:47.940657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e100-8a98-4d23-bd92-8cf03b09588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:47.941500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e100-8a98-4d23-bd92-8cf03b09588d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:47.941782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e100-8a98-4d23-bd92-8cf03b09588d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:47.942052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e100-8a98-4d23-bd92-8cf03b09588d None admin] PATH_INFO: `/v3/projects/07fd022a754a4b53b46cb7ab14d40660` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:47.943212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9e100-8a98-4d23-bd92-8cf03b09588d None admin] RBAC: Authorizing `identity:get_project(project_id=07fd022a754a4b53b46cb7ab14d40660)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:47.944652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9e100-8a98-4d23-bd92-8cf03b09588d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:47.946307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 593/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jun 16 11:39:47 2022] GET /identity/v3/projects/07fd022a754a4b53b46cb7ab14d40660 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:47.952968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:39:47.964083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:48.046361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e031f-9008-4963-8c0a-37113a6e9660 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:39:48.079380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:39:48.079986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:39:48.080267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:39:48.080539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:39:48.081357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=07fd022a754a4b53b46cb7ab14d40660, user.id=7c0102b0386443a98ff68a115f11c1a7) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:39:48.081667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:39:48.083109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f92f8-4ddf-4e55-805b-05ce2e211928 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:39:48.088744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 607/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:39:47 2022] GET /identity/v3/role_assignments?user.id=7c0102b0386443a98ff68a115f11c1a7&scope.project.id=07fd022a754a4b53b46cb7ab14d40660&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:39:57.936320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=53 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:39:58.086104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=63 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:40:58.325490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1265e76-87a0-4bf1-87fd-3f00fc43eff9 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:40:58.326070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1265e76-87a0-4bf1-87fd-3f00fc43eff9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:40:58.326070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1265e76-87a0-4bf1-87fd-3f00fc43eff9 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:40:58.327564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 594/1201] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:40:58.335526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8272133-003c-4485-9306-4d6557826d73 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:40:58.335936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8272133-003c-4485-9306-4d6557826d73 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:40:58.336071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8272133-003c-4485-9306-4d6557826d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:40:58.352927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d8272133-003c-4485-9306-4d6557826d73 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:40:58.354090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d8272133-003c-4485-9306-4d6557826d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:40:58.417806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 608/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:40:58.441836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1265e76-87a0-4bf1-87fd-3f00fc43eff9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:40:58.538774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1265e76-87a0-4bf1-87fd-3f00fc43eff9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:40:58.573544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:40:58.574881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:40:58.575221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:40:58.575551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:40:58.587143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:40:58.588616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:40:58.607996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:40:58.609215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:40:58.610274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:40:58.610274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:40:58.610274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:40:58.610274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:40:58.610274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 595/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:40:58.615762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8272133-003c-4485-9306-4d6557826d73 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:40:58.712444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8272133-003c-4485-9306-4d6557826d73 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:40:58.740852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:40:58.746856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:40:58.747540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:40:58.747822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:40:58.748100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:40:58.748846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:40:58.749152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:40:58.750533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4384ca1-acd5-4a28-826f-085438c5ad47 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:40:58.761902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 609/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:40:58.767838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:40:58.821245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:40:58.868281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf76fd-12f4-44a2-b331-2746e0c0ef69 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:40:58.904088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba4f9a-568f-4153-a254-f851b7dcf8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:40:58.904761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba4f9a-568f-4153-a254-f851b7dcf8f2 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:40:58.905049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba4f9a-568f-4153-a254-f851b7dcf8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:40:58.905330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba4f9a-568f-4153-a254-f851b7dcf8f2 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:40:58.906026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba4f9a-568f-4153-a254-f851b7dcf8f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:40:58.907488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba4f9a-568f-4153-a254-f851b7dcf8f2 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:40:58.967680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 596/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jun 16 11:40:58 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:41:01.083582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8adce-98d4-42ea-9194-d62dc900e694 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.084122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8adce-98d4-42ea-9194-d62dc900e694 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.084122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8adce-98d4-42ea-9194-d62dc900e694 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:01.085522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 610/1206] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:01.090549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.091014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.091139 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:01.108067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:01.109228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:01.174854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 597/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:01.198221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8adce-98d4-42ea-9194-d62dc900e694 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:01.312589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8adce-98d4-42ea-9194-d62dc900e694 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:01.346890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:01.347685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.347969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.348244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:01.358850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:41:01.366456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:01.367655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:01.368546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 611/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:01.373861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:01.412630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:01.470520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c643c0-90ce-4c84-8a97-196cd9f8e530 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:01.505430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:01.506263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.506546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.506932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:01.507675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:01.507982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:01.509332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:01.517191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 598/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:01.523767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:01.573032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:01.634287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7be9c-f1b6-4b51-abf6-57e142055489 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:01.668620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:01.669427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.669709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.669984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:01.679904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:01.681464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:01.699027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:01.700065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:01.701440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:01.701440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:01.701440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:01.701440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:01.701440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 612/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:01.705977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:01.799097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:01.801959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c58d-f70b-49bc-b54e-47b5bbb3c361 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:01.833541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:01.834183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.834462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.834762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:01.835466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:01.835766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:01.837100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:01.848687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 599/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:01.854277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:01.961201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff65dc-97c2-4d2b-b635-86e741f54c6c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:01.962776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:01.994411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:01.995338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:01.995624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:01.995905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] PATH_INFO: `/v3/users/placement` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:02.003083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:02.005098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:41:02.018930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:02.024403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:02.025759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 613/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:02.026579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:02.123639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16e040-fcc6-4c72-bcf7-4c0dfee1082c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:02.156928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:02.157566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:02.157843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:02.158121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:02.158971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:02.159273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:02.160702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:02.176978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 600/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jun 16 11:41:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:02.182674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:02.287410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f810-7a8e-4470-a70a-5055319a7beb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:02.321735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:02.322378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:02.322697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:02.322979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:02.352040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:02.388603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:02.390024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:02.485390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 614/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:41:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:41:02.491638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:02.510370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:02.592409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2dd8-2f3b-437e-b6b2-e9df92285fa6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:02.624877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:02.625655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:02.625934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:02.626207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:02.636399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:02.637810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:02.657389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:02.658469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:02.659623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:02.659623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:02.659623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:02.659623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:02.659623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 601/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:02.662345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:02.726557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:02.762839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb281-8319-41b6-9957-e5fa53c96371 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:02.795436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:02.796102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:02.796380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:02.796649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:02.797358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:02.797659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:02.799043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:02.810393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 615/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:41:02.816050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:02.883867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:02.915438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834ba42-41dd-4e68-8994-75975d446296 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:02.949120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:02.949906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:02.950183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:02.950458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:02.956974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:02.958381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:41:02.971890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:02.977022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:02.977921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 602/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:02.979623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:03.078313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e324bc-1718-49dc-b3ab-ba9b0121f6ef None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:03.100551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:03.111786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:03.112427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:03.112706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:03.113007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:03.113821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:03.114125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:03.115608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e4e6d-683e-4d36-ab43-68d2a8257e07 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:03.127113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 616/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:03.133193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:03.230885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c99f-bf99-4278-930e-1f6bc899157d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:03.257885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:03.263647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:03.264332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:03.264612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:03.264887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:03.265710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=17efad13e88b4d58be51b897827532f8) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:03.266021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:03.267465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffef26-eeec-444c-8065-868ff52d6e1f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:03.273466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 603/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:41:03 2022] GET /identity/v3/role_assignments?user.id=17efad13e88b4d58be51b897827532f8&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:05.386950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196b08-b93b-4878-9baf-bea76c176af5 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:05.387528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196b08-b93b-4878-9baf-bea76c176af5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:05.387528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196b08-b93b-4878-9baf-bea76c176af5 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:05.388876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 617/1220] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:05.394000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:05.394974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:05.395095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:05.412250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:05.413479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:05.477605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 604/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:05.500129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196b08-b93b-4878-9baf-bea76c176af5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:05.599499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196b08-b93b-4878-9baf-bea76c176af5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:05.631625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:05.632408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:05.632694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:05.632972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:05.642880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:41:05.651181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:05.652080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:05.653054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 618/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:05.658522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:05.755064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b930-4fa8-4902-bbf1-aae9fee07050 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:05.778123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:05.788477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:05.789140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:05.789426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:05.789693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:05.790431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:05.790768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:05.795149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:05.799745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 605/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:05.805449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:05.848030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:05.903876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b9d6-f470-4ed1-8eb6-64cfabae35f6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:05.935754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:05.936533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:05.936813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:05.937121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:05.948131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:05.949625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:05.966907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:05.967849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:05.968848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:05.968848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:05.968848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:05.968848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:05.968848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 619/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:05.974018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:06.075317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46499a19-0c04-4e80-8041-fd3b6b67b0d8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:06.107939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:06.108715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:06.109000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:06.109277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:06.110020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:06.110321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:06.111693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:06.123719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 606/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:06.130221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:06.223620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:06.230054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6100-1219-4458-9927-337a0c1f36c1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:06.263887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:06.264732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:06.265012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:06.265284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:06.272680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:06.274126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:41:06.288050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:06.289192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:06.290361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 620/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:06.301532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:06.352582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:06.402155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32719e6-ff10-48f5-be14-0da87f390ce6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:06.435396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:06.436057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:06.436389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:06.436665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:06.437493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:06.437802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:06.439247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:06.456280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 607/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jun 16 11:41:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:06.462179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:06.561344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5abc90-6cfb-4a5e-bc25-f172c51e95b0 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:06.593332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:06.594107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:06.594387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:06.594689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:06.605402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:06.606916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:06.625365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:06.626538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:06.627587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:06.627587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:06.627587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:06.627587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:06.627587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 621/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:06.632506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:06.731011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6021e-5a6f-45b5-ac41-153f62d87b10 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:06.733320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:06.764236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:06.764887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:06.765170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:06.765446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:06.766162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:06.766466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:06.767907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:06.779043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 608/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:06.784509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:06.794148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:06.884255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60975024-4454-412f-806c-cd46707ae3b6 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:06.916594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:06.917373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:06.917677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:06.917947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:06.924344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:06.926300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:41:06.940140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:06.941837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:06.943215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 622/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:06.947734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:07.041975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa773-6f5a-4e2b-af95-5ab1d941a082 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:07.074807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:07.077500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:07.077500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:07.077500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:07.077500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:07.077500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:07.078416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8418f94-8205-47eb-b365-02ba2716ec1c None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:07.089960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 609/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:07.096054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:07.160257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:07.193773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4747-080d-4521-a4a2-7eb26dbb0747 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:07.226275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd14ae-6ba8-4baf-8207-90c12ef8cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:07.227190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd14ae-6ba8-4baf-8207-90c12ef8cac6 None admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:07.227475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd14ae-6ba8-4baf-8207-90c12ef8cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:07.227752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd14ae-6ba8-4baf-8207-90c12ef8cac6 None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/17efad13e88b4d58be51b897827532f8/roles/10fd0b05b00c47ed997e6f389775d62d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:07.242816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd14ae-6ba8-4baf-8207-90c12ef8cac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=17efad13e88b4d58be51b897827532f8, role_id=10fd0b05b00c47ed997e6f389775d62d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:07.249452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd14ae-6ba8-4baf-8207-90c12ef8cac6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:07.344863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 623/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:41:07 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/17efad13e88b4d58be51b897827532f8/roles/10fd0b05b00c47ed997e6f389775d62d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:41:09.403943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3e84-f633-43f3-9908-5888b9af79fb None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:09.404571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3e84-f633-43f3-9908-5888b9af79fb None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:09.404571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3e84-f633-43f3-9908-5888b9af79fb None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:09.405903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 610/1233] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:09.411447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:09.411839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:09.411995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:09.427626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:09.429164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:09.493454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 624/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:09.516605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3e84-f633-43f3-9908-5888b9af79fb None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:09.541663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:09.622459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3e84-f633-43f3-9908-5888b9af79fb None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:09.655778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:09.656500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:09.656784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:09.657061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] PATH_INFO: `/v3/roles/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:09.667425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:41:09.675076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:09.676737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:09.677968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 611/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jun 16 11:41:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:09.682858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:09.728475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:09.779965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0a9c-1a68-45e6-93f9-f5bd4c9acb8a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:09.813632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:09.814302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:09.814612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:09.814893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:09.815634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] RBAC: Adding query filter params (name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:09.815945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:09.817603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:09.826259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 625/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jun 16 11:41:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:09.832530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:09.917789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:09.933123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f9003-eac6-4f22-9c6f-0cb30618aeec None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:09.965867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:09.966675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:09.966985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:09.967291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:09.978809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:09.980235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:09.997298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:10.000097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:10.001250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:10.001250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:10.001250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:10.001250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:10.001250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 612/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:10.004732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:10.102324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b5dc-3813-4c33-b516-e607af8a875e None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:10.111199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:10.135748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:10.136409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:10.136694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:10.136974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:10.137691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:10.138000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:10.139431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:10.151073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 626/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:10.162292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:10.252123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e8dcc-7efc-4c2d-8542-e67fe25b78df None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:10.285269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:10.286105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:10.286392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:10.286699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:10.289403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:10.294340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:10.295796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:41:10.309718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:10.310748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:10.311770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 613/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:41:10.317264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:10.415503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8b61c-c16c-4221-b3a7-04b2527fd310 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:10.447739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:10.448393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:10.448674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:10.448967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:10.449775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:10.450082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:10.451517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:10.469305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 627/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jun 16 11:41:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:10.475112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:10.572091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f534e3-93f8-4120-8189-639cc1f07c98 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:10.605009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:10.605647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:10.605932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:10.606208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:10.673673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:10.680594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:10.682039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:10.777158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 614/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:41:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:41:10.782952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:10.810264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:10.881565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3c9b6-8061-4011-96bd-75168737f970 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:10.914308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:10.915191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:10.915477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:10.915762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:10.926220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:10.927690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:10.949258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:10.950428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:10.951396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:10.951396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:10.951396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:10.951396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:10.951396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 628/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:10.957207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:11.048402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:11.054608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9918397-0156-443a-85f3-5bf11825e5d7 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:11.087151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:11.087809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:11.088090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:11.088366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:11.089080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:11.089395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:11.090771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:11.102758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 615/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:11.108314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:11.184844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:11.205755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1162d-78f4-4aca-ae03-5c94a3925927 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:11.239520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:11.240294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:11.240575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:11.240849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:11.247257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:11.248702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:41:11.262157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:11.263216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:11.264557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 629/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:41:11.269220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:11.367527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c6f5f-ca20-47f4-b585-306d6f72108b None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:11.400014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:11.400652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:11.400981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:11.401260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:11.402035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:11.402342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:11.403778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42512-0985-4a8b-b01c-6abbd6cc618d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:11.416064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 616/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:11.422023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:11.518805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c91b-eaa2-41d6-a39a-946e25a6bb94 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:11.551709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:11.552345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:11.552624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:11.552897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:11.553716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] RBAC: Adding query filter params (role.id=10fd0b05b00c47ed997e6f389775d62d, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=17efad13e88b4d58be51b897827532f8) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:11.554024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:11.555571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18721-abfc-4f0a-855e-7b6fe75d52b6 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:11.563592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 630/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:41:11 2022] GET /identity/v3/role_assignments?user.id=17efad13e88b4d58be51b897827532f8&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=10fd0b05b00c47ed997e6f389775d62d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:41:13.686579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e3de-fd1a-4dcf-9073-0391705f59cd None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:13.687173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e3de-fd1a-4dcf-9073-0391705f59cd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:13.687264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e3de-fd1a-4dcf-9073-0391705f59cd None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:13.688627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 617/1247] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:13.694404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:13.694851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:13.694999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:13.700014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:13.711651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:13.715596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:13.775869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 631/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:13.798814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e3de-fd1a-4dcf-9073-0391705f59cd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:13.817823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:13.897892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e3de-fd1a-4dcf-9073-0391705f59cd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:13.930375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:13.931187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:13.931469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:13.931744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:13.942095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:41:13.949676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:13.950842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:13.952286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 618/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:13.956945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:14.052178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f038ba-f805-415d-9ef9-de96b79e0b14 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:14.080079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:14.085156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:14.085811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:14.086093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:14.086365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:14.087347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:14.087656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:14.089163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:14.098184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 632/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:14.106186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:14.177716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:14.199292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f467660-39a5-47ae-bc42-7fb401029cb8 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:14.231282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:14.232056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:14.232335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:14.232607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:14.243411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:14.244821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:14.261822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:14.267641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:14.268560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:14.268560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:14.268560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:14.268560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:14.268560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 619/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:14.268845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:14.367317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be634af-08dc-4c7f-a465-fd6504f35b81 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:14.400207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:14.400861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:14.401144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:14.401422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:14.402141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:14.402448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:14.403902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:14.415832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 633/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:41:14.421637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:14.518381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269971-d32b-4a49-8310-ffc38eee9039 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:14.543840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:14.551487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:14.552274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:14.552556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:14.552829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:14.559931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:14.561348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:41:14.575422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:14.576569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:14.577823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 620/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:41:14.582950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:14.635890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:14.677903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9750f1c-243d-4c81-811c-a945765743d2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:14.713196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:14.713848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:14.714129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:14.714400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:14.715255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:14.715605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:14.717039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:14.733716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 634/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jun 16 11:41:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:14.739486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:14.840159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b568ca8-30c2-40dc-9a97-57aaf0012be6 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:14.875172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:14.875818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:14.876103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:14.876378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:14.930805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:14.943386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:14.947349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:15.043880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 621/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:41:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:41:15.049656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:15.146389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8f57-20a1-4bc8-ac7f-e530c9bebad1 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:15.158835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:15.179163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:15.179933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:15.180214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:15.180485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:15.190234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:15.192295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:15.210296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:15.213982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:15.215165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:15.215165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:15.215165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:15.215165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:15.215165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 635/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:15.217098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:15.301049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:15.312346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feac8f1-a7b9-4268-bd9b-bee333ba92ec None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:15.344657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:15.345294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:15.345573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:15.345843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:15.346548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:15.346878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:15.348211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:15.359253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 622/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:15.365338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:15.461743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03318ea9-5875-47e4-aa0b-4144e5c739ec None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:15.495290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:15.496111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:15.496391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:15.496663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:15.503135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:15.504613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:41:15.518426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:15.519571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:15.520902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 636/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:15.525456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:15.621208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e3c33-e963-49f1-bda3-eac6f61bd1de None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:15.653886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:15.654525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:15.654825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:15.655099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:15.655864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:15.656168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:15.657565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79b15-532e-48ad-9f4a-77d2c8196f63 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:15.668938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 623/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:15.674913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:15.701017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:15.774114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722294d-4886-4f6b-899c-d2a7dc4abaeb None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:15.806469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:15.807184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:15.807418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:15.807691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:15.808511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=17efad13e88b4d58be51b897827532f8) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:15.808820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:15.810241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43536d3e-25f1-4676-ab54-9141d2ae0b55 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:15.815532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 637/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:41:15 2022] GET /identity/v3/role_assignments?user.id=17efad13e88b4d58be51b897827532f8&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:17.920687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfded000-c1e8-495b-acfa-ccd23439a09b None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:17.921246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfded000-c1e8-495b-acfa-ccd23439a09b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:17.921246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfded000-c1e8-495b-acfa-ccd23439a09b None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:17.928085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 624/1261] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:17.933177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980008f7-0e67-4397-8c98-699558b82aee None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:17.933595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980008f7-0e67-4397-8c98-699558b82aee None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:17.936653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980008f7-0e67-4397-8c98-699558b82aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:17.950725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-980008f7-0e67-4397-8c98-699558b82aee None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:17.953844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-980008f7-0e67-4397-8c98-699558b82aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:18.017330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 638/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:18.039564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfded000-c1e8-495b-acfa-ccd23439a09b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:18.050256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:18.140857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfded000-c1e8-495b-acfa-ccd23439a09b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:18.180794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:18.180794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:18.180794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:18.180794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:18.188924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:41:18.196278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:18.197404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:18.198445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 625/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:41:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:18.203693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980008f7-0e67-4397-8c98-699558b82aee None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:18.222205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:18.300510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980008f7-0e67-4397-8c98-699558b82aee None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:18.335372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:18.336147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:18.336434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:18.336709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:18.337448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:18.337756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:18.339271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:18.347317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 639/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:41:18.353625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:18.419130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:18.452526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cd296-79dd-455b-8d0e-c6b01d21aa2c None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:18.485950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:18.486773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:18.487142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:18.487419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:18.498681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:18.500101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:18.517500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:18.518578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:18.520341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:18.520341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:18.520341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:18.520341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:18.520341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 626/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:18.525145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:18.604013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:18.622090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca4b2-63f5-457b-a511-ac3fe2160a5c None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:18.655747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:18.656390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:18.656671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:18.656945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:18.657654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:18.657957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:18.659358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:18.670679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 640/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:18.676310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:18.775241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5acdf-0248-4c06-a60a-36addd31fe78 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:18.793898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:18.810522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:18.811350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:18.811630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:18.811902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:18.819954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:18.824065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:41:18.835804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:18.836966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:18.838132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 627/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:18.842913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:18.940079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7479c-8d77-4af1-b120-b06c40f7ccf9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:18.979780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:18.980477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:18.980761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:18.981037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:18.981876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:18.982187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:18.983656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:18.993452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:19.001676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 641/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jun 16 11:41:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:19.007942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:19.103666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122482-6d11-4b76-bfea-b040322b19fc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:19.136432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:19.137208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:19.137486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:19.137758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:19.147850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:19.149253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:19.165558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:19.166645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:19.167580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:19.167580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:19.167580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:19.167580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:19.167580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 628/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:19.172349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:19.272396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9fc53-57cd-409b-abb1-4c623b7fa3b2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:19.305624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:19.306268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:19.306550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:19.306859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:19.307576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:19.307900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:19.309244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:19.320382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 642/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:19.325952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:19.357369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:19.424215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45171afa-0a0f-4006-b34b-731bf5616519 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:19.457021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:19.457850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:19.458133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:19.458409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:19.464858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:19.466279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:41:19.480652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:19.481694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:19.487482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 629/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:19.488697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:19.545119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:19.585450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6979ac-98b4-4ede-be4d-0d01d0c47c1d None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:19.618101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:19.618782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:19.619064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:19.619338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:19.620117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:19.620421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:19.621851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82300679-04d7-4f88-acbd-78de01c1472f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:19.633432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 643/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:19.639403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:19.728569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:19.736829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889583-5891-4207-94a9-9063f303edfd None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:19.768774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541c2b-ef85-47f8-8611-6baa9a62323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:19.770153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541c2b-ef85-47f8-8611-6baa9a62323d None admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:19.770433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541c2b-ef85-47f8-8611-6baa9a62323d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:19.770732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541c2b-ef85-47f8-8611-6baa9a62323d None admin] PATH_INFO: `/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/17efad13e88b4d58be51b897827532f8/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:19.772637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6541c2b-ef85-47f8-8611-6baa9a62323d None admin] RBAC: Authorizing `identity:create_grant(project_id=f980675b94054871bcae0aaeaf9bd290, user_id=17efad13e88b4d58be51b897827532f8, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:19.774040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6541c2b-ef85-47f8-8611-6baa9a62323d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:19.848012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 630/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jun 16 11:41:19 2022] PUT /identity/v3/projects/f980675b94054871bcae0aaeaf9bd290/users/17efad13e88b4d58be51b897827532f8/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:41:21.949997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8bff-23e6-49fb-8b0b-7382a15a5494 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:21.950680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8bff-23e6-49fb-8b0b-7382a15a5494 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:21.950680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8bff-23e6-49fb-8b0b-7382a15a5494 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:21.951938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 644/1274] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:41:21.958082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:21.958567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:21.958868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:21.975142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:21.976333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:22.045690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 631/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:22.070281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8bff-23e6-49fb-8b0b-7382a15a5494 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:22.168300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8bff-23e6-49fb-8b0b-7382a15a5494 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:22.185295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:22.201967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:22.202779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:22.203059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:22.203332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:22.213223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 11:41:22.220759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:22.221876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:22.223331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 645/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jun 16 11:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:22.228702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:22.306700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:22.323975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e52a0a-d341-420c-8624-13128a6ca547 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:22.356660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:22.357314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:22.357594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:22.357865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:22.358628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:22.358937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:22.360280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:22.368610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 632/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jun 16 11:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:22.374235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:22.469367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ad20-5150-46d3-be0f-ddc4be369b92 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:22.503497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:22.504315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:22.504597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:22.504875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:22.515013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:22.516550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:22.533140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:22.534189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:22.535994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:22.535994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:22.535994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:22.535994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:22.535994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 646/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:22.540560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:22.637221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973eada-72a8-4912-9275-fdf2caf7ec19 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:22.669911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:22.670484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:22.670795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:22.671072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:22.671785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:22.672165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:22.673447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:22.684839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 633/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:22.690754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:22.730040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:22.797421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdea9c-4bf6-43bf-8c9c-68b39c0c1f4f None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:22.830124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:22.830945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:22.831231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:22.831514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:22.839232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:22.840672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 11:41:22.855311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:22.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:22.857636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 647/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:22.864461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:22.868713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:22.961879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fc798-a973-4f67-b0c5-f9dbbd5ef5fc None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:22.995118 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:22.995681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:22.995959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:22.996227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:22.997248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:22.997795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:22.999279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:23.015968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 634/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jun 16 11:41:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:41:23.021685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:23.110601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:23.120045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ed65e-4f82-45a0-9563-7aea7e2e11f9 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:23.151368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:23.152000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:23.152284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:23.152561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:23.218038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:23.219526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:23.305915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:23.315678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 648/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jun 16 11:41:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 11:41:23.321708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:23.381134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:23.417838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a0630-b612-4e88-af99-755f2c1c7d8f None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:23.450160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:23.451031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:23.451310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:23.451583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:23.461982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:23.463435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 11:41:23.481733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:23.482847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:23.483801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 11:41:23.483801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 11:41:23.483801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 11:41:23.483801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:23.483801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 635/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:23.488799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:23.584250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a0b84-ea94-48f5-ad0c-31c38aba4c65 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:23.617432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:23.618245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:23.618528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:23.618830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:23.619541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:23.619843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:23.621201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:23.632366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 649/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jun 16 11:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:23.637907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:23.735099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b15b0-fe63-40cc-bb90-c9072eaa6244 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:23.748585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:23.768047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:23.768823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:23.769102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:23.769373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:23.776375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:23.777782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 11:41:23.791549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:23.792581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: ERROR keystone.server.flask.application Jun 16 11:41:23.793472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 636/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jun 16 11:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:23.798666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:23.848847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:23.897793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3bbd1-a6f4-46ba-9337-36c7cf448dfd None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:23.929941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:23.930685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:23.930982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:23.931256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:23.932112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:23.932421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:23.933831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b33e05-57eb-4092-9489-ee03e51c2eeb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:23.946515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 650/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jun 16 11:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:23.952624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:24.054452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5f96-b1ef-4f13-b814-b990272b032d None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:24.087317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:24.087952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:24.088250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:24.088506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:24.089324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] RBAC: Adding query filter params (role.id=e19ffe8952bd42cab77eea1f65717c00, scope.project.id=f980675b94054871bcae0aaeaf9bd290, user.id=17efad13e88b4d58be51b897827532f8) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:24.089634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:24.091079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4004-b717-433c-bd72-fdba83fd7523 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:24.096743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 637/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jun 16 11:41:23 2022] GET /identity/v3/role_assignments?user.id=17efad13e88b4d58be51b897827532f8&scope.project.id=f980675b94054871bcae0aaeaf9bd290&role.id=e19ffe8952bd42cab77eea1f65717c00 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:26.240740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcd06d-cc7d-456d-bf42-ee2edc292ffc None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:26.241254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcd06d-cc7d-456d-bf42-ee2edc292ffc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:26.241254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcd06d-cc7d-456d-bf42-ee2edc292ffc None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:26.242646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 651/1288] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:26.247814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:26.248185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:26.248370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:26.264927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:26.266119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:26.295864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:26.332785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 638/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:26.355957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcd06d-cc7d-456d-bf42-ee2edc292ffc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:26.452859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcd06d-cc7d-456d-bf42-ee2edc292ffc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:26.463432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:26.485602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:26.486374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:26.486690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:26.486963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:26.487606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:26.488956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:26.504349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:26.505597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:26.506728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 652/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:41:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 11:41:26.507790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:26.605729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5882e-3b60-42fa-b365-1828fef3875a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:26.638218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:26.638898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:26.639183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:26.639462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:26.640158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] RBAC: Adding query filter params (name=placement) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:26.640481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:26.641835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bfe17-3e48-49b0-9e4c-a288f788b31b None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:26.647109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 639/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jun 16 11:41:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:41:26.652951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:26.752918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277f77-612e-4396-90c7-09c4731bc6a2 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:26.785975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:26.786704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:26.787049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:26.787327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] PATH_INFO: `/v3/services` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:26.788059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] RBAC: Adding query filter params (type=placement) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:26.788366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:26.789846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9bcbe-5643-4519-bfd7-5d4eeac75beb None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:26.796244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 653/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jun 16 11:41:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:28.882799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780b9a-81ca-4b4d-995e-810d28523023 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:28.883336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780b9a-81ca-4b4d-995e-810d28523023 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:28.883336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780b9a-81ca-4b4d-995e-810d28523023 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:28.884699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 640/1293] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:28.889923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476476-33ff-43c3-be59-f1b012fdbac8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:28.890357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476476-33ff-43c3-be59-f1b012fdbac8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:28.890486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476476-33ff-43c3-be59-f1b012fdbac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:28.907546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b0476476-33ff-43c3-be59-f1b012fdbac8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:28.908763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b0476476-33ff-43c3-be59-f1b012fdbac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:28.937899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:28.973732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 654/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:28.996389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae780b9a-81ca-4b4d-995e-810d28523023 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:29.028242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:29.095858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae780b9a-81ca-4b4d-995e-810d28523023 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:29.129052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876d0a3-ecb4-4119-a075-d9714ebb56d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:29.129699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876d0a3-ecb4-4119-a075-d9714ebb56d3 None admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:29.129984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876d0a3-ecb4-4119-a075-d9714ebb56d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:29.130263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876d0a3-ecb4-4119-a075-d9714ebb56d3 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:29.131512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876d0a3-ecb4-4119-a075-d9714ebb56d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:29.132965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876d0a3-ecb4-4119-a075-d9714ebb56d3 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:29.202181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 641/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jun 16 11:41:28 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:41:31.316563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de497-9ee6-4a7e-b4bc-ec1396eace5f None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:31.317357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de497-9ee6-4a7e-b4bc-ec1396eace5f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:31.317357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7de497-9ee6-4a7e-b4bc-ec1396eace5f None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:31.319391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 655/1296] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:31.324589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:31.325019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:31.325135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:31.342417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:31.343628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:31.413808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 642/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:31.436707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7de497-9ee6-4a7e-b4bc-ec1396eace5f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:31.534882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7de497-9ee6-4a7e-b4bc-ec1396eace5f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:31.567674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:31.568407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:31.568687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:31.568963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:31.569606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:31.571004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:31.582903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:31.584509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:31.585411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 656/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:41:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:31.590854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:31.609079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:31.692987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e1c64-b0e4-4f26-baf7-e3fd463f79bc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:31.726117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:31.726800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:31.727104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:31.727350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:31.728047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:31.728348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:31.729688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:31.734634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 643/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jun 16 11:41:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:31.740782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:31.770836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:31.836778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9225714-2fb6-4fcf-b420-374f04732c90 None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:31.869783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:31.870434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:31.870753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:31.871031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:31.871814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] RBAC: Adding query filter params (interface=public, service_id=ca9bc44113e744cd9411d6903d44ed60, region_id=RegionOne) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:31.872125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:31.873484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f00b17-c398-436f-aabe-3274212e6da8 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:31.883310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 657/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jun 16 11:41:31 2022] GET /identity/v3/endpoints?service_id=ca9bc44113e744cd9411d6903d44ed60&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:31.884376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:31.964000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:31.981449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8f74-1f5b-4fc4-b9d1-19974f886fb4 None admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:32.024237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cd047-ec4b-4f52-9a0d-720d31175eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:32.024899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cd047-ec4b-4f52-9a0d-720d31175eee None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:32.025182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cd047-ec4b-4f52-9a0d-720d31175eee None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:32.025457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cd047-ec4b-4f52-9a0d-720d31175eee None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:32.026133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cd047-ec4b-4f52-9a0d-720d31175eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:32.027521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cd047-ec4b-4f52-9a0d-720d31175eee None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:32.034153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 644/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jun 16 11:41:31 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:41:34.148237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75067546-5ccb-482b-9b93-cf2eac8b38cd None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:34.148738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75067546-5ccb-482b-9b93-cf2eac8b38cd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:34.148738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75067546-5ccb-482b-9b93-cf2eac8b38cd None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:34.150120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 658/1302] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:41:34.155520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:34.155961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:34.156056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:34.172665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:41:34.173879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:41:34.239688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 645/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:41:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 11:41:34.263173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75067546-5ccb-482b-9b93-cf2eac8b38cd None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:34.359167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:34.365793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75067546-5ccb-482b-9b93-cf2eac8b38cd None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:34.398934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:34.399659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:34.399940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:34.400208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] PATH_INFO: `/v3/services/placement` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:34.400850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:34.402250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 11:41:34.413880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 11:41:34.418463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application with Lock( Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self._enter() Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application return self.creator() Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application created_value = creator( Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: ERROR keystone.server.flask.application Jun 16 11:41:34.419406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 659/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jun 16 11:41:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 11:41:34.421419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:34.496833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:34.518919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049d9f-699a-4f4f-922e-183cd4d273f6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:34.551707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:34.552908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:34.553188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:34.553458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] PATH_INFO: `/v3/services` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:34.554151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:41:34.554454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:34.555824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44e25-2d93-4170-975e-0b8bde5495d9 None admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:34.560913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 646/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jun 16 11:41:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:41:34.566950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:41:34.664637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20d05-c2cd-4a12-a452-0945b1a83ebc None admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:41:34.698016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeffd3-be77-44c7-8049-6d17b1501817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:41:34.698691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeffd3-be77-44c7-8049-6d17b1501817 None admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:41:34.698976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeffd3-be77-44c7-8049-6d17b1501817 None admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:41:34.699251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeffd3-be77-44c7-8049-6d17b1501817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:41:34.699987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeffd3-be77-44c7-8049-6d17b1501817 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:41:34.701350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeffd3-be77-44c7-8049-6d17b1501817 None admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:41:34.825918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 660/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jun 16 11:41:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:41:44.557833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=30 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:41:44.821337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:29.866861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127c32e-b546-463a-9236-2dbb6e01daba None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:29.867461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127c32e-b546-463a-9236-2dbb6e01daba None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:29.867461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127c32e-b546-463a-9236-2dbb6e01daba None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:29.874618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca4f2-e537-4460-ac7b-ca3f6fbeac60 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:29.875172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca4f2-e537-4460-ac7b-ca3f6fbeac60 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:29.875172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca4f2-e537-4460-ac7b-ca3f6fbeac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:29.883851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 647/1307] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:29 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:29.962409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-0a0ca4f2-e537-4460-ac7b-ca3f6fbeac60 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:29.963671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0a0ca4f2-e537-4460-ac7b-ca3f6fbeac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:30.132122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 661/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:47:30.171073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604413-afdd-4a6c-9b21-9565e8e51789 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:30.171434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604413-afdd-4a6c-9b21-9565e8e51789 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:30.171862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604413-afdd-4a6c-9b21-9565e8e51789 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:30.173807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 648/1309] 10.222.0.36 () {54 vars in 964 bytes} [Thu Jun 16 11:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:30.179909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d69f-9d9b-4808-a64c-861fcdc41ec4 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:30.180165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d69f-9d9b-4808-a64c-861fcdc41ec4 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:30.180445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737d69f-9d9b-4808-a64c-861fcdc41ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:30.297194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1737d69f-9d9b-4808-a64c-861fcdc41ec4 None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:30.298962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1737d69f-9d9b-4808-a64c-861fcdc41ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:30.321670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:30.379730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 662/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Jun 16 11:47:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:30.388250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604413-afdd-4a6c-9b21-9565e8e51789 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:30.390551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-eb604413-afdd-4a6c-9b21-9565e8e51789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:30.510170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604413-afdd-4a6c-9b21-9565e8e51789 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:30.587930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:30.588583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:30.588861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:30.589131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:30.590968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:30.648485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:30.705510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:30.707113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b9900-a968-4730-a687-df77fc5f924b service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:30.726032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 649/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:33.140301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773f17-9cbc-432c-8b00-b540a0b473d5 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:33.140825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773f17-9cbc-432c-8b00-b540a0b473d5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:33.140825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773f17-9cbc-432c-8b00-b540a0b473d5 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:33.142146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 663/1312] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:33.147222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca371c-ff4a-4afc-bdef-b93554b22d04 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:33.147633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca371c-ff4a-4afc-bdef-b93554b22d04 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:33.147900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca371c-ff4a-4afc-bdef-b93554b22d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:33.226458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-54ca371c-ff4a-4afc-bdef-b93554b22d04 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:33.227693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-54ca371c-ff4a-4afc-bdef-b93554b22d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:33.322990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 650/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:33.361681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5773f17-9cbc-432c-8b00-b540a0b473d5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:33.363408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d5773f17-9cbc-432c-8b00-b540a0b473d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:33.473554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5773f17-9cbc-432c-8b00-b540a0b473d5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:33.554490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:33.557201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:33.557848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:33.558130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:33.558406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:33.560105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:33.667077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:33.668510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1227b-3324-4294-a244-ed770b7c9b57 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:33.686915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 664/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:36.406011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3f36-37a5-408e-95b5-cff96ac871c8 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:36.406517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3f36-37a5-408e-95b5-cff96ac871c8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:36.406517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3f36-37a5-408e-95b5-cff96ac871c8 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:36.407838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 651/1315] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:36.412931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d695d0-1093-40d3-b5c9-1a88ce62f1ae None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:36.413350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d695d0-1093-40d3-b5c9-1a88ce62f1ae None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:36.413497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d695d0-1093-40d3-b5c9-1a88ce62f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:36.478303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a7d695d0-1093-40d3-b5c9-1a88ce62f1ae None None] MFA Rules not processed for user `ba67684123ea44258dad40cd957714e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:36.479538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a7d695d0-1093-40d3-b5c9-1a88ce62f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:36.530520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:36.574197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 665/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:36.614760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3f36-37a5-408e-95b5-cff96ac871c8 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:36.616274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b37e3f36-37a5-408e-95b5-cff96ac871c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:36.625948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:36.718824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3f36-37a5-408e-95b5-cff96ac871c8 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:36.788121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:36.788746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:36.789025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:36.789295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:36.790918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:36.850657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:36.897201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:36.898721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e9b5b-9f72-4ceb-b097-bbe7129715ab service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:36.916197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 652/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:39.843273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01ade-62ae-413a-9ac9-3fd556e74326 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:39.843830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01ade-62ae-413a-9ac9-3fd556e74326 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:39.843830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01ade-62ae-413a-9ac9-3fd556e74326 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:39.845197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 666/1318] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:39.850400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f351b4-b341-4eff-b62b-e08301c17828 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:39.850822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f351b4-b341-4eff-b62b-e08301c17828 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:39.850987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f351b4-b341-4eff-b62b-e08301c17828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:39.913752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-60f351b4-b341-4eff-b62b-e08301c17828 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:39.914980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-60f351b4-b341-4eff-b62b-e08301c17828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:40.009541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 653/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:40.048112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01ade-62ae-413a-9ac9-3fd556e74326 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:40.049661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-97d01ade-62ae-413a-9ac9-3fd556e74326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:40.148719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01ade-62ae-413a-9ac9-3fd556e74326 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:40.219012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:40.219644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:40.219924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:40.220197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:40.221810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:40.228961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:40.327893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:40.329311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5635c-ef0f-4480-ac8e-de72edbfc3cb service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:40.346646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 667/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:43.411933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b493db9-f210-426d-be8f-8072372a089a None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:43.412468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b493db9-f210-426d-be8f-8072372a089a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:43.412468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b493db9-f210-426d-be8f-8072372a089a None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:43.414082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 654/1321] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:43.420192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7ffcc-21a9-4b7b-90b0-6ed709bc7107 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:43.420730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7ffcc-21a9-4b7b-90b0-6ed709bc7107 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:43.420827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7ffcc-21a9-4b7b-90b0-6ed709bc7107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:43.486697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-09e7ffcc-21a9-4b7b-90b0-6ed709bc7107 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:43.487894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-09e7ffcc-21a9-4b7b-90b0-6ed709bc7107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:43.548082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:43.592690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 668/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:43.630111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b493db9-f210-426d-be8f-8072372a089a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:43.631765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7b493db9-f210-426d-be8f-8072372a089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:43.652872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:43.740147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b493db9-f210-426d-be8f-8072372a089a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:43.813046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:43.813685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:43.813961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:43.814233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:43.815885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:43.885285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:43.922559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:43.923998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1ac02-d79f-488a-ac53-a77140de670f service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:43.942064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 655/1323] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:46.112987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad762-81c9-4b4e-ad9b-44023fe40f97 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:46.113855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad762-81c9-4b4e-ad9b-44023fe40f97 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:46.114136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad762-81c9-4b4e-ad9b-44023fe40f97 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:46.115662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 669/1324] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:46.120874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976645-b908-47c9-b44f-e52c4be6d38a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:46.121288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976645-b908-47c9-b44f-e52c4be6d38a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:46.121444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976645-b908-47c9-b44f-e52c4be6d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:46.185359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b3976645-b908-47c9-b44f-e52c4be6d38a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:46.187052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b3976645-b908-47c9-b44f-e52c4be6d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:46.284219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 656/1325] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:46.320065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad762-81c9-4b4e-ad9b-44023fe40f97 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:46.321603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-425ad762-81c9-4b4e-ad9b-44023fe40f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:46.422274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad762-81c9-4b4e-ad9b-44023fe40f97 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:46.495225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:46.495873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:46.496154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:46.496435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:46.498068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:46.515436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:46.615642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:46.617071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e089-d33e-466e-8883-7110a34b46ff service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:46.635224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 670/1326] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:48.829205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c338b-8b39-49eb-ae92-e339ed0967a0 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:48.829802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c338b-8b39-49eb-ae92-e339ed0967a0 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:48.829802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c338b-8b39-49eb-ae92-e339ed0967a0 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:48.831434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 657/1327] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:48.837057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e513-12d8-4a1f-bf1d-874102132ab8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:48.837547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e513-12d8-4a1f-bf1d-874102132ab8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:48.837657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e513-12d8-4a1f-bf1d-874102132ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:48.905433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cb27e513-12d8-4a1f-bf1d-874102132ab8 None None] MFA Rules not processed for user `ba67684123ea44258dad40cd957714e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:48.906659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cb27e513-12d8-4a1f-bf1d-874102132ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:48.969022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:49.000658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 671/1328] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:49.037624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c338b-8b39-49eb-ae92-e339ed0967a0 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:49.039245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e63c338b-8b39-49eb-ae92-e339ed0967a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:49.070534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:49.144809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c338b-8b39-49eb-ae92-e339ed0967a0 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:49.226781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:49.227435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:49.227716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:49.227990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:49.229637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:49.322807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:49.355816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:49.357252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc833c1-9ba3-4f37-a7fe-955b7680260c service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:49.379783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 658/1329] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:52.059768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa1ef1-3d6c-4eca-9f9b-2109db04c729 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:52.060354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa1ef1-3d6c-4eca-9f9b-2109db04c729 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:52.060354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa1ef1-3d6c-4eca-9f9b-2109db04c729 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:52.061634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 672/1330] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:52.067117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8105c-6393-4686-995c-34ab2765da9d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:52.067529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8105c-6393-4686-995c-34ab2765da9d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:52.067651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8105c-6393-4686-995c-34ab2765da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:52.130112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8dd8105c-6393-4686-995c-34ab2765da9d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:52.131396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8dd8105c-6393-4686-995c-34ab2765da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:52.224474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 659/1331] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:52.259474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa1ef1-3d6c-4eca-9f9b-2109db04c729 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:52.261010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-aaaa1ef1-3d6c-4eca-9f9b-2109db04c729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:52.362026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa1ef1-3d6c-4eca-9f9b-2109db04c729 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:52.431936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:52.432570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:52.432852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:52.433126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:52.434767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:52.461034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:52.540378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:52.541802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c558f5a-2a89-4961-9d02-6205f664655f service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:52.559231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 673/1332] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:54.713730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c8c6e-d637-4c79-bc29-7f164cf017d6 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:54.714313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c8c6e-d637-4c79-bc29-7f164cf017d6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:54.714313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c8c6e-d637-4c79-bc29-7f164cf017d6 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:54.715685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 660/1333] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:54.721483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632e12-597d-4820-a9c6-3e5e8ebf0969 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:54.721905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632e12-597d-4820-a9c6-3e5e8ebf0969 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:54.722042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632e12-597d-4820-a9c6-3e5e8ebf0969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:54.785284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3b632e12-597d-4820-a9c6-3e5e8ebf0969 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:54.786490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3b632e12-597d-4820-a9c6-3e5e8ebf0969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:54.858350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:54.881169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 674/1334] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:54.934063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f906a-7e9f-417d-b0f4-c94e0bdf8210 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:54.934348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f906a-7e9f-417d-b0f4-c94e0bdf8210 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:54.934653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f906a-7e9f-417d-b0f4-c94e0bdf8210 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:54.936647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 661/1335] 10.222.0.36 () {54 vars in 964 bytes} [Thu Jun 16 11:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:54.942087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77ed81-5ced-4b35-bafd-1e10d4ab40a0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:54.942380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77ed81-5ced-4b35-bafd-1e10d4ab40a0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:54.942684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77ed81-5ced-4b35-bafd-1e10d4ab40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:55.018188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cc77ed81-5ced-4b35-bafd-1e10d4ab40a0 None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:55.019417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cc77ed81-5ced-4b35-bafd-1e10d4ab40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:55.092083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 675/1336] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Jun 16 11:47:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:55.101038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f906a-7e9f-417d-b0f4-c94e0bdf8210 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:55.102528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0f9f906a-7e9f-417d-b0f4-c94e0bdf8210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:55.142014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:55.203807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f906a-7e9f-417d-b0f4-c94e0bdf8210 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:55.276162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:55.276732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:55.277016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:55.277292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:55.278955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:55.359309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:55.384105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:55.385513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5188ac6-d7a4-45ea-b92e-a29a53e3126a service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:55.403203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 662/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:47:58.619020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896833b9-b5a8-4747-9e8c-bdb19e4826d5 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:58.619669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896833b9-b5a8-4747-9e8c-bdb19e4826d5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:58.619669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896833b9-b5a8-4747-9e8c-bdb19e4826d5 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:58.620965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 676/1338] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:47:58.626707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17614-2dfd-4ca0-9e43-55491af505ba None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:58.627140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17614-2dfd-4ca0-9e43-55491af505ba None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:58.627244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17614-2dfd-4ca0-9e43-55491af505ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:58.690656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-43a17614-2dfd-4ca0-9e43-55491af505ba None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:47:58.691847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-43a17614-2dfd-4ca0-9e43-55491af505ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:58.783895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 663/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:47:58.819370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896833b9-b5a8-4747-9e8c-bdb19e4826d5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:47:58.820956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-896833b9-b5a8-4747-9e8c-bdb19e4826d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:58.899361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:47:58.926653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896833b9-b5a8-4747-9e8c-bdb19e4826d5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:47:59.000172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:47:59.000813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:47:59.001092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:47:59.001366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:47:59.003040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:47:59.110393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:47:59.111869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f43911-1ca9-4a1b-9031-55d75ff8769f service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:47:59.130402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 677/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:47:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:03.553223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a0e8-7e0a-4cb3-9f67-925753cd84f4 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:03.553766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a0e8-7e0a-4cb3-9f67-925753cd84f4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:03.553766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a0e8-7e0a-4cb3-9f67-925753cd84f4 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:03.555238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 664/1341] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:48:03.560529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124a60-ee2f-4617-99e2-cbc732c59fa3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:03.561017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124a60-ee2f-4617-99e2-cbc732c59fa3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:03.566389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124a60-ee2f-4617-99e2-cbc732c59fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:03.568002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:03.632867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-95124a60-ee2f-4617-99e2-cbc732c59fa3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:03.634072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-95124a60-ee2f-4617-99e2-cbc732c59fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:03.739155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 678/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:03.777652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a0e8-7e0a-4cb3-9f67-925753cd84f4 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:03.779874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3178a0e8-7e0a-4cb3-9f67-925753cd84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:03.828871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:03.877125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a0e8-7e0a-4cb3-9f67-925753cd84f4 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:03.880859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ade8-2cfc-4be2-a107-47003b67750d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:03.881578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ade8-2cfc-4be2-a107-47003b67750d service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:03.881936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ade8-2cfc-4be2-a107-47003b67750d service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:03.882286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ade8-2cfc-4be2-a107-47003b67750d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:03.891749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168ade8-2cfc-4be2-a107-47003b67750d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:03.893172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168ade8-2cfc-4be2-a107-47003b67750d service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:03.902671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 665/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:07.006703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc70f-9f89-40a6-a0ec-ad0bdcfd278e None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:07.007281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc70f-9f89-40a6-a0ec-ad0bdcfd278e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:07.007281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc70f-9f89-40a6-a0ec-ad0bdcfd278e None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:07.008642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 679/1344] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:07.013823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f6797-0c39-47fc-b78b-bd2c027eb01c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:07.014213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f6797-0c39-47fc-b78b-bd2c027eb01c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:07.014422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f6797-0c39-47fc-b78b-bd2c027eb01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:07.041588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-984f6797-0c39-47fc-b78b-bd2c027eb01c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:07.042801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-984f6797-0c39-47fc-b78b-bd2c027eb01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:07.119332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 666/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:07.155807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dc70f-9f89-40a6-a0ec-ad0bdcfd278e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:07.166308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dc70f-9f89-40a6-a0ec-ad0bdcfd278e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:07.169838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045c68e-30da-4d13-ae1b-515b7784c891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:07.171121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c68e-30da-4d13-ae1b-515b7784c891 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:07.171406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c68e-30da-4d13-ae1b-515b7784c891 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:07.171681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c68e-30da-4d13-ae1b-515b7784c891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:07.180510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045c68e-30da-4d13-ae1b-515b7784c891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:07.181924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045c68e-30da-4d13-ae1b-515b7784c891 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:07.191495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 680/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:11.343540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f240fed-ac24-4655-bb22-ca3afc380445 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:11.344058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f240fed-ac24-4655-bb22-ca3afc380445 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:11.344058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f240fed-ac24-4655-bb22-ca3afc380445 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:11.345548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 667/1347] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:11.350441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef092-2049-4a66-908d-1c0bdbfa47c5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:11.350903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef092-2049-4a66-908d-1c0bdbfa47c5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:11.351021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef092-2049-4a66-908d-1c0bdbfa47c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:11.370187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-352ef092-2049-4a66-908d-1c0bdbfa47c5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:11.371440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-352ef092-2049-4a66-908d-1c0bdbfa47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:11.379282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 681/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:48:11.416431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f240fed-ac24-4655-bb22-ca3afc380445 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:11.427680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f240fed-ac24-4655-bb22-ca3afc380445 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:11.431368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532bbc5-4b42-45ac-9fbd-bd98953d95b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:11.431997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532bbc5-4b42-45ac-9fbd-bd98953d95b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:11.432280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532bbc5-4b42-45ac-9fbd-bd98953d95b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:11.432584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532bbc5-4b42-45ac-9fbd-bd98953d95b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:11.441537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532bbc5-4b42-45ac-9fbd-bd98953d95b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:11.442982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532bbc5-4b42-45ac-9fbd-bd98953d95b3 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:11.452467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 668/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:16.508781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f198-c324-42bb-87a0-edd5188fff4d None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:16.509308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f198-c324-42bb-87a0-edd5188fff4d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:16.509392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f198-c324-42bb-87a0-edd5188fff4d None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:16.511247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 682/1350] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:16.516855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed8178-86e6-44a4-9a6f-85b9edb4462e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:16.517634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed8178-86e6-44a4-9a6f-85b9edb4462e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:16.522612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed8178-86e6-44a4-9a6f-85b9edb4462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:16.628967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-92ed8178-86e6-44a4-9a6f-85b9edb4462e None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:16.630120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-92ed8178-86e6-44a4-9a6f-85b9edb4462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:16.659613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:16.711942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 669/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:48:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:20.937714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae431c1c-02c4-4a7e-aab7-23c9773ba0d1 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:20.938292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae431c1c-02c4-4a7e-aab7-23c9773ba0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:20.938533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae431c1c-02c4-4a7e-aab7-23c9773ba0d1 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:20.940097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 683/1352] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:48:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:20.945345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ba04-ee96-4ecf-9859-1e3bbd72d321 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:20.945806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ba04-ee96-4ecf-9859-1e3bbd72d321 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:20.946104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ba04-ee96-4ecf-9859-1e3bbd72d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:20.965503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3c78ba04-ee96-4ecf-9859-1e3bbd72d321 None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:20.966975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3c78ba04-ee96-4ecf-9859-1e3bbd72d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:20.977069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 670/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:21.365107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=72 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:22.572341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585d06-39cb-4d81-b993-aedc949f227c None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:22.572938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585d06-39cb-4d81-b993-aedc949f227c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:22.572938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585d06-39cb-4d81-b993-aedc949f227c None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:22.574374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 684/1354] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:22.579269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b602e3-d5a6-458f-86aa-95541cd2f0ab None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:22.579716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b602e3-d5a6-458f-86aa-95541cd2f0ab None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:22.579986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b602e3-d5a6-458f-86aa-95541cd2f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:22.599905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-56b602e3-d5a6-458f-86aa-95541cd2f0ab None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:22.601088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-56b602e3-d5a6-458f-86aa-95541cd2f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:22.610815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 671/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:48:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:48:26.254824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617434fb-7501-4b62-a339-0212761c59cd None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:26.255341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617434fb-7501-4b62-a339-0212761c59cd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:26.255341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617434fb-7501-4b62-a339-0212761c59cd None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:26.256715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 685/1356] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:26.262085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0999-8919-4f16-bfb6-bb99ec2adcaf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:26.262506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0999-8919-4f16-bfb6-bb99ec2adcaf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:26.262689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0999-8919-4f16-bfb6-bb99ec2adcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:26.280950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9c7a0999-8919-4f16-bfb6-bb99ec2adcaf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:26.282135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9c7a0999-8919-4f16-bfb6-bb99ec2adcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:26.290841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 672/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:26.344446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400af66-1c86-4413-bb58-bbce390e859d None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:26.345120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400af66-1c86-4413-bb58-bbce390e859d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:26.345503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400af66-1c86-4413-bb58-bbce390e859d None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:26.347156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 686/1358] 10.222.0.36 () {54 vars in 961 bytes} [Thu Jun 16 11:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:26.356536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212e89-c0b8-4ad8-b1f1-946d7f989396 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:26.357088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212e89-c0b8-4ad8-b1f1-946d7f989396 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:26.359157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212e89-c0b8-4ad8-b1f1-946d7f989396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:26.409895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-74212e89-c0b8-4ad8-b1f1-946d7f989396 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:26.411121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-74212e89-c0b8-4ad8-b1f1-946d7f989396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:26.501356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 673/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Jun 16 11:48:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:26.509002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400af66-1c86-4413-bb58-bbce390e859d None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:26.524435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400af66-1c86-4413-bb58-bbce390e859d None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:26.530200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f7984-6ea3-4f8c-8cca-a0bc0bb033a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:26.530944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7984-6ea3-4f8c-8cca-a0bc0bb033a3 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:26.538204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7984-6ea3-4f8c-8cca-a0bc0bb033a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:26.538204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7984-6ea3-4f8c-8cca-a0bc0bb033a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:26.540666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f7984-6ea3-4f8c-8cca-a0bc0bb033a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:26.542321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f7984-6ea3-4f8c-8cca-a0bc0bb033a3 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:26.552418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 687/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:28.924649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222afb-202d-4d19-8784-3e4b06f26f63 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:28.925246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222afb-202d-4d19-8784-3e4b06f26f63 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:28.925246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222afb-202d-4d19-8784-3e4b06f26f63 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:28.926672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 674/1361] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:28.932618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf440-cdc2-4bf3-b8b2-f1eddcb1e939 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:28.933136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf440-cdc2-4bf3-b8b2-f1eddcb1e939 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:28.933784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf440-cdc2-4bf3-b8b2-f1eddcb1e939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:28.954864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b8ebf440-cdc2-4bf3-b8b2-f1eddcb1e939 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:28.956516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b8ebf440-cdc2-4bf3-b8b2-f1eddcb1e939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:28.965800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 688/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:29.013277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01222afb-202d-4d19-8784-3e4b06f26f63 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:29.027918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01222afb-202d-4d19-8784-3e4b06f26f63 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:29.033894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b698f-a659-432b-ad84-6a8b1c839497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:29.034536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b698f-a659-432b-ad84-6a8b1c839497 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:29.034852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b698f-a659-432b-ad84-6a8b1c839497 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:29.035150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b698f-a659-432b-ad84-6a8b1c839497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:29.044592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b698f-a659-432b-ad84-6a8b1c839497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:29.046243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b698f-a659-432b-ad84-6a8b1c839497 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:29.066758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 675/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:31.614995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0cad5-cf30-4778-a8de-389804d7c833 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:31.615501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0cad5-cf30-4778-a8de-389804d7c833 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:31.615644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0cad5-cf30-4778-a8de-389804d7c833 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:31.616944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 689/1364] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:31.622214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc466f-c540-4bff-ae33-95705a0fb42d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:31.622659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc466f-c540-4bff-ae33-95705a0fb42d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:31.622875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc466f-c540-4bff-ae33-95705a0fb42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:31.641080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3cfc466f-c540-4bff-ae33-95705a0fb42d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:31.642261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3cfc466f-c540-4bff-ae33-95705a0fb42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:31.650349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 676/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:31.698816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bba36-7769-4719-8ab3-82a534ba7db3 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:31.699102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bba36-7769-4719-8ab3-82a534ba7db3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:31.699376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bba36-7769-4719-8ab3-82a534ba7db3 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:31.700754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 690/1366] 10.222.0.36 () {54 vars in 961 bytes} [Thu Jun 16 11:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:31.706285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901c7d-30ef-4ad7-aea5-d34903b11cda None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:31.706576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901c7d-30ef-4ad7-aea5-d34903b11cda None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:31.706892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901c7d-30ef-4ad7-aea5-d34903b11cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:31.738389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-64901c7d-30ef-4ad7-aea5-d34903b11cda None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:31.739741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-64901c7d-30ef-4ad7-aea5-d34903b11cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:31.748787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 677/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Jun 16 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:31.756610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bba36-7769-4719-8ab3-82a534ba7db3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:31.771635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bba36-7769-4719-8ab3-82a534ba7db3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:31.781527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871cbf-48b4-4d32-8e5d-c481ac911a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:31.782212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871cbf-48b4-4d32-8e5d-c481ac911a1e service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:31.782496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871cbf-48b4-4d32-8e5d-c481ac911a1e service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:31.782796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871cbf-48b4-4d32-8e5d-c481ac911a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:31.793691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04871cbf-48b4-4d32-8e5d-c481ac911a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:31.796086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04871cbf-48b4-4d32-8e5d-c481ac911a1e service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:31.807252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 691/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:34.188546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b456-6a7e-40b0-a5a5-883972b19451 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.189076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b456-6a7e-40b0-a5a5-883972b19451 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.189591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b456-6a7e-40b0-a5a5-883972b19451 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.191138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 678/1369] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:34.196355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624f8a-28f9-41eb-b0c7-937df144754d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.196775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624f8a-28f9-41eb-b0c7-937df144754d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.196966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624f8a-28f9-41eb-b0c7-937df144754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.215337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9a624f8a-28f9-41eb-b0c7-937df144754d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:34.216523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9a624f8a-28f9-41eb-b0c7-937df144754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:34.224804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 692/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:48:34.269690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b456-6a7e-40b0-a5a5-883972b19451 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:34.284079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b456-6a7e-40b0-a5a5-883972b19451 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:34.289617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d388b78-dc58-4da9-a246-973e4f639c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:34.290246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d388b78-dc58-4da9-a246-973e4f639c96 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.290527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d388b78-dc58-4da9-a246-973e4f639c96 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.290835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d388b78-dc58-4da9-a246-973e4f639c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.299831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d388b78-dc58-4da9-a246-973e4f639c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:34.301401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d388b78-dc58-4da9-a246-973e4f639c96 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:34.311902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 679/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:34.444066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49587e9-070d-4bba-a1ff-444b36b9fec4 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.444280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49587e9-070d-4bba-a1ff-444b36b9fec4 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.444552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49587e9-070d-4bba-a1ff-444b36b9fec4 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.445929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 693/1372] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:34.450979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468111a-99fe-4570-9fc8-b10a3e9a1324 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.451274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468111a-99fe-4570-9fc8-b10a3e9a1324 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.451555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468111a-99fe-4570-9fc8-b10a3e9a1324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.469365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8468111a-99fe-4570-9fc8-b10a3e9a1324 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:34.470608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8468111a-99fe-4570-9fc8-b10a3e9a1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:34.478579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 680/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:48:34.785108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464575-778a-4c59-8017-7dac61b5d4ba None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.785405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464575-778a-4c59-8017-7dac61b5d4ba None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.785673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464575-778a-4c59-8017-7dac61b5d4ba None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.787117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 694/1374] 10.222.0.36 () {54 vars in 963 bytes} [Thu Jun 16 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:34.792490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0f66-d755-48c7-b04b-45135047b2d2 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.792854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0f66-d755-48c7-b04b-45135047b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.793204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0f66-d755-48c7-b04b-45135047b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.800648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:34.843567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3d7f0f66-d755-48c7-b04b-45135047b2d2 None None] MFA Rules not processed for user `8dd8663dd0584d859bfb3268355f6a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:34.844791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3d7f0f66-d755-48c7-b04b-45135047b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:34.924515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 681/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Thu Jun 16 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:34.933813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464575-778a-4c59-8017-7dac61b5d4ba None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:34.949025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464575-778a-4c59-8017-7dac61b5d4ba None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:34.958442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8baa1-cf5a-43e3-b47b-86644d0e44a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:34.959139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8baa1-cf5a-43e3-b47b-86644d0e44a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:34.959882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8baa1-cf5a-43e3-b47b-86644d0e44a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:34.962075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8baa1-cf5a-43e3-b47b-86644d0e44a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:34.970920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8baa1-cf5a-43e3-b47b-86644d0e44a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:34.972365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8baa1-cf5a-43e3-b47b-86644d0e44a7 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:34.982500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 695/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:36.741206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac1bb-016f-4d9a-9c2b-d1208328cfd6 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:36.741760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac1bb-016f-4d9a-9c2b-d1208328cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:36.741760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac1bb-016f-4d9a-9c2b-d1208328cfd6 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:36.743081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 682/1377] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:36.749545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec9ae-1184-4cd8-8e3c-a097268581a0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:36.750117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec9ae-1184-4cd8-8e3c-a097268581a0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:36.750211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec9ae-1184-4cd8-8e3c-a097268581a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:36.768408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f4dec9ae-1184-4cd8-8e3c-a097268581a0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:36.771550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f4dec9ae-1184-4cd8-8e3c-a097268581a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:36.777641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 696/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:36.823773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac1bb-016f-4d9a-9c2b-d1208328cfd6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:36.838449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac1bb-016f-4d9a-9c2b-d1208328cfd6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:36.844439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cf965-3999-46a2-a929-3403de7da722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:36.845093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cf965-3999-46a2-a929-3403de7da722 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:36.845380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cf965-3999-46a2-a929-3403de7da722 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:36.845651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cf965-3999-46a2-a929-3403de7da722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:36.858631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cf965-3999-46a2-a929-3403de7da722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:36.860393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cf965-3999-46a2-a929-3403de7da722 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:36.871317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 683/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:39.172046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a4328-0105-4555-9ddc-55dc8f3b6908 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:39.172905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a4328-0105-4555-9ddc-55dc8f3b6908 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:39.173341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a4328-0105-4555-9ddc-55dc8f3b6908 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:39.180530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74350-f051-4435-b76a-a09eaa7716d2 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:39.181416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74350-f051-4435-b76a-a09eaa7716d2 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:39.181855 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74350-f051-4435-b76a-a09eaa7716d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:39.183992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 697/1380] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:39.202507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-faf74350-f051-4435-b76a-a09eaa7716d2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:39.204020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-faf74350-f051-4435-b76a-a09eaa7716d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:39.227248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 684/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:48:39.260846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a4328-0105-4555-9ddc-55dc8f3b6908 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:39.276745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a4328-0105-4555-9ddc-55dc8f3b6908 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:39.282843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c5a00-90f4-4513-b46a-a000605f8044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:39.283487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c5a00-90f4-4513-b46a-a000605f8044 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:39.283773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c5a00-90f4-4513-b46a-a000605f8044 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:39.284053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c5a00-90f4-4513-b46a-a000605f8044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:39.293064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c5a00-90f4-4513-b46a-a000605f8044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:39.294672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c5a00-90f4-4513-b46a-a000605f8044 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:39.304469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 698/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:41.571966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc086-9f76-4908-9c71-786804bc7004 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:41.572502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc086-9f76-4908-9c71-786804bc7004 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:41.572631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc086-9f76-4908-9c71-786804bc7004 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:41.573898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 685/1383] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:41.579516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39069780-369e-453f-a299-4fe8a30a1245 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:41.579949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39069780-369e-453f-a299-4fe8a30a1245 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:41.580081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39069780-369e-453f-a299-4fe8a30a1245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:41.600366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-39069780-369e-453f-a299-4fe8a30a1245 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:41.601764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-39069780-369e-453f-a299-4fe8a30a1245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:41.613709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 699/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:41.657741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc086-9f76-4908-9c71-786804bc7004 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:41.674338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc086-9f76-4908-9c71-786804bc7004 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:41.680167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79ea29-9574-4b23-910a-149e100b6c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:41.680952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ea29-9574-4b23-910a-149e100b6c21 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:41.681567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ea29-9574-4b23-910a-149e100b6c21 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:41.681915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ea29-9574-4b23-910a-149e100b6c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:41.691551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79ea29-9574-4b23-910a-149e100b6c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:41.693131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79ea29-9574-4b23-910a-149e100b6c21 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:41.704374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 686/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:48:43.834332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb55947-74c3-4ab5-9d88-fead1d3d09b3 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:43.834879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb55947-74c3-4ab5-9d88-fead1d3d09b3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:43.834974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb55947-74c3-4ab5-9d88-fead1d3d09b3 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:43.836374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 700/1386] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:43.841675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6407ce7-b766-4cc6-a04d-d6db806395a6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:43.842102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6407ce7-b766-4cc6-a04d-d6db806395a6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:43.842214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6407ce7-b766-4cc6-a04d-d6db806395a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:43.860560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c6407ce7-b766-4cc6-a04d-d6db806395a6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:43.861763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c6407ce7-b766-4cc6-a04d-d6db806395a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:43.869569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 687/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:43.916469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb55947-74c3-4ab5-9d88-fead1d3d09b3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:43.931997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb55947-74c3-4ab5-9d88-fead1d3d09b3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:43.938145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57135a-064c-4037-87d1-4a7103974766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:43.938833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57135a-064c-4037-87d1-4a7103974766 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:43.939157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57135a-064c-4037-87d1-4a7103974766 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:43.939396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57135a-064c-4037-87d1-4a7103974766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:43.948548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57135a-064c-4037-87d1-4a7103974766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:43.950137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57135a-064c-4037-87d1-4a7103974766 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:43.961241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 701/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:46.213196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353989d-7dcf-4b56-9ad5-da02b2f880c9 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:46.213712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353989d-7dcf-4b56-9ad5-da02b2f880c9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:46.213712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353989d-7dcf-4b56-9ad5-da02b2f880c9 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:46.215059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 688/1389] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:46.221863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb75a-0c88-4c43-9cf3-24378b0a2eb6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:46.222341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb75a-0c88-4c43-9cf3-24378b0a2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:46.222435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb75a-0c88-4c43-9cf3-24378b0a2eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:46.242834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dbacb75a-0c88-4c43-9cf3-24378b0a2eb6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:46.244073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dbacb75a-0c88-4c43-9cf3-24378b0a2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:46.252655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 702/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:46.304329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353989d-7dcf-4b56-9ad5-da02b2f880c9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:46.319184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353989d-7dcf-4b56-9ad5-da02b2f880c9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:46.324601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4078-f8a2-42e4-9a9e-27fe97fe8974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:46.325236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4078-f8a2-42e4-9a9e-27fe97fe8974 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:46.325517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4078-f8a2-42e4-9a9e-27fe97fe8974 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:46.325789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4078-f8a2-42e4-9a9e-27fe97fe8974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:46.334332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb4078-f8a2-42e4-9a9e-27fe97fe8974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:46.335924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb4078-f8a2-42e4-9a9e-27fe97fe8974 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:46.345367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 689/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:49.056784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750795d-b1cc-4b4b-876e-c30d7af146bb None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:49.057315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750795d-b1cc-4b4b-876e-c30d7af146bb None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:49.057315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750795d-b1cc-4b4b-876e-c30d7af146bb None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:49.058736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 703/1392] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:49.064340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f632c9-29e3-4b89-8cc5-07cf4792ad46 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:49.064741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f632c9-29e3-4b89-8cc5-07cf4792ad46 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:49.064907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f632c9-29e3-4b89-8cc5-07cf4792ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:49.083565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-75f632c9-29e3-4b89-8cc5-07cf4792ad46 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:49.084747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-75f632c9-29e3-4b89-8cc5-07cf4792ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:49.092477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 690/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:49.135372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750795d-b1cc-4b4b-876e-c30d7af146bb None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:49.150930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750795d-b1cc-4b4b-876e-c30d7af146bb None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:49.156405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e63f9-0c61-495a-a0bf-b70c2de22f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:49.157036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e63f9-0c61-495a-a0bf-b70c2de22f7f service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:49.157320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e63f9-0c61-495a-a0bf-b70c2de22f7f service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:49.157625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e63f9-0c61-495a-a0bf-b70c2de22f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:49.165851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e63f9-0c61-495a-a0bf-b70c2de22f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:49.167463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e63f9-0c61-495a-a0bf-b70c2de22f7f service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:49.177311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 704/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:50.763133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9be0-efd1-4a6b-8ed8-ee9f0290c03f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:50.763784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9be0-efd1-4a6b-8ed8-ee9f0290c03f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:50.763784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9be0-efd1-4a6b-8ed8-ee9f0290c03f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:50.765583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 691/1395] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:50.770682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e762-0723-4a8d-9ffb-692d67bf4754 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:50.771111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e762-0723-4a8d-9ffb-692d67bf4754 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:50.771251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e762-0723-4a8d-9ffb-692d67bf4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:50.789433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cd60e762-0723-4a8d-9ffb-692d67bf4754 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:50.790686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cd60e762-0723-4a8d-9ffb-692d67bf4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:50.798705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 705/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:50.853817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91764-b46e-4a05-b7f3-90e0952246f7 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:50.854329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91764-b46e-4a05-b7f3-90e0952246f7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:50.854637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91764-b46e-4a05-b7f3-90e0952246f7 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:50.855997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 692/1397] 10.222.0.36 () {54 vars in 962 bytes} [Thu Jun 16 11:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:50.861465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e058d4f-ca1c-4ef2-9750-65885e74a3d2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:50.861789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e058d4f-ca1c-4ef2-9750-65885e74a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:50.862070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e058d4f-ca1c-4ef2-9750-65885e74a3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:50.911511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9e058d4f-ca1c-4ef2-9750-65885e74a3d2 None None] MFA Rules not processed for user `14349e981de34943823081c4470cea88`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:50.912713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9e058d4f-ca1c-4ef2-9750-65885e74a3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:50.974064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 706/1398] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Jun 16 11:48:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:50.981593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91764-b46e-4a05-b7f3-90e0952246f7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:50.992720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91764-b46e-4a05-b7f3-90e0952246f7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:50.996212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d340b1-e451-4b40-8bda-ba70c0ed0e61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:50.996841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d340b1-e451-4b40-8bda-ba70c0ed0e61 service glance] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:50.997121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d340b1-e451-4b40-8bda-ba70c0ed0e61 service glance] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:50.997396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d340b1-e451-4b40-8bda-ba70c0ed0e61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:51.006965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d340b1-e451-4b40-8bda-ba70c0ed0e61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:51.008373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d340b1-e451-4b40-8bda-ba70c0ed0e61 service glance] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:51.017601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 693/1399] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:51.424418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38c4d-351a-48a2-945f-7ac7eb02ea6a None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:51.424619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38c4d-351a-48a2-945f-7ac7eb02ea6a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:51.424919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38c4d-351a-48a2-945f-7ac7eb02ea6a None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:51.426552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 707/1400] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:51.432059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd299f-2166-4597-95e9-6be6a5077850 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:51.432346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd299f-2166-4597-95e9-6be6a5077850 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:51.432622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd299f-2166-4597-95e9-6be6a5077850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:51.451213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-99cd299f-2166-4597-95e9-6be6a5077850 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:51.452449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-99cd299f-2166-4597-95e9-6be6a5077850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:51.464432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 694/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:51.510025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38c4d-351a-48a2-945f-7ac7eb02ea6a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:51.518398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=93 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:51.525565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38c4d-351a-48a2-945f-7ac7eb02ea6a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:51.531403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae71ad-e4a3-4fa3-a941-35a2defb917a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:51.532263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae71ad-e4a3-4fa3-a941-35a2defb917a service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:51.532591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae71ad-e4a3-4fa3-a941-35a2defb917a service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:51.532967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae71ad-e4a3-4fa3-a941-35a2defb917a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:51.543729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae71ad-e4a3-4fa3-a941-35a2defb917a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:51.545418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae71ad-e4a3-4fa3-a941-35a2defb917a service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:51.557256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 708/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:48:51.884445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4226-e56b-4252-8100-c19aafa5dce5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:51.885021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4226-e56b-4252-8100-c19aafa5dce5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:51.885021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4226-e56b-4252-8100-c19aafa5dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:51.934451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-cfea4226-e56b-4252-8100-c19aafa5dce5 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:51.935594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cfea4226-e56b-4252-8100-c19aafa5dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:51.966431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:48:52.010488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 695/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:48:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:52.051907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5de93-74ac-42a3-990b-8b2a146f7e25 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:52.052407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5de93-74ac-42a3-990b-8b2a146f7e25 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:52.052513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5de93-74ac-42a3-990b-8b2a146f7e25 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:52.053864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 709/1404] 10.222.0.36 () {54 vars in 942 bytes} [Thu Jun 16 11:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:52.060040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891179bb-202f-4a60-a52c-e93b827e1ea5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:52.060337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891179bb-202f-4a60-a52c-e93b827e1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:52.060612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891179bb-202f-4a60-a52c-e93b827e1ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:52.108033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-891179bb-202f-4a60-a52c-e93b827e1ea5 None None] MFA Rules not processed for user `8cfd6158f5124d7cb71c8a77485ff6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:52.109836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-891179bb-202f-4a60-a52c-e93b827e1ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:52.184627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 696/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Thu Jun 16 11:48:52 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:48:52.194625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5de93-74ac-42a3-990b-8b2a146f7e25 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:52.210128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5de93-74ac-42a3-990b-8b2a146f7e25 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:52.215033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d809a-0f0f-4054-a113-bad7f3e07580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:52.215665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d809a-0f0f-4054-a113-bad7f3e07580 service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:52.215947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d809a-0f0f-4054-a113-bad7f3e07580 service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:52.216225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d809a-0f0f-4054-a113-bad7f3e07580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:52.224746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d809a-0f0f-4054-a113-bad7f3e07580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:52.226312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d809a-0f0f-4054-a113-bad7f3e07580 service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:52.235016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 710/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:48:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:48:53.853833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aed9e-dc05-4e1f-9d82-ac101b330d60 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:53.854398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aed9e-dc05-4e1f-9d82-ac101b330d60 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:53.854398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aed9e-dc05-4e1f-9d82-ac101b330d60 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:53.855802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 697/1407] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:48:53.862327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1e00-3811-4023-bf50-20b2be648401 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:53.862802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1e00-3811-4023-bf50-20b2be648401 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:53.862945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1e00-3811-4023-bf50-20b2be648401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:53.882788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f7ed1e00-3811-4023-bf50-20b2be648401 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:48:53.884532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f7ed1e00-3811-4023-bf50-20b2be648401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:48:53.895159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 711/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:48:53.939236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aed9e-dc05-4e1f-9d82-ac101b330d60 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:48:53.954236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aed9e-dc05-4e1f-9d82-ac101b330d60 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:48:53.962351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a703d-2988-49c8-a1f9-52d937729214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:48:53.963038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a703d-2988-49c8-a1f9-52d937729214 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:48:53.963322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a703d-2988-49c8-a1f9-52d937729214 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:48:53.963595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a703d-2988-49c8-a1f9-52d937729214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:48:53.974372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a703d-2988-49c8-a1f9-52d937729214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:48:53.975982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a703d-2988-49c8-a1f9-52d937729214 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:48:53.987046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 698/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:03.875230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=14 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:49:03.982400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=62 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:49:15.711988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b13d9-713b-4969-9d47-77d662f0bc41 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:15.712592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b13d9-713b-4969-9d47-77d662f0bc41 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:15.712592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b13d9-713b-4969-9d47-77d662f0bc41 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:15.713963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 712/1410] 10.222.0.36 () {54 vars in 918 bytes} [Thu Jun 16 11:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:15.719743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059423-e4c5-4cc1-a7ac-a6b4f9dbe810 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:15.720154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059423-e4c5-4cc1-a7ac-a6b4f9dbe810 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:15.720324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059423-e4c5-4cc1-a7ac-a6b4f9dbe810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:15.737787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f2059423-e4c5-4cc1-a7ac-a6b4f9dbe810 None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:15.739005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f2059423-e4c5-4cc1-a7ac-a6b4f9dbe810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:15.747188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 699/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jun 16 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:15.761022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0bee-9990-4d79-a155-60f3df973c21 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:15.761313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0bee-9990-4d79-a155-60f3df973c21 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:15.761594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0bee-9990-4d79-a155-60f3df973c21 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:15.762987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 713/1412] 10.222.0.36 () {54 vars in 918 bytes} [Thu Jun 16 11:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:15.767951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d897d96-8c65-4a06-b6a4-c567c1e7085b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:15.768233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d897d96-8c65-4a06-b6a4-c567c1e7085b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:15.768503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d897d96-8c65-4a06-b6a4-c567c1e7085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:15.786009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9d897d96-8c65-4a06-b6a4-c567c1e7085b None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:15.787192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9d897d96-8c65-4a06-b6a4-c567c1e7085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:15.796022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 700/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jun 16 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:49:18.373275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d066-c2c6-4f34-9e36-58a715db6cef None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:18.373845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d066-c2c6-4f34-9e36-58a715db6cef None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:18.373845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d066-c2c6-4f34-9e36-58a715db6cef None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:18.375914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:18.381200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea1340-9427-4c08-a3b8-8bfd8fc5780e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:18.381597 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea1340-9427-4c08-a3b8-8bfd8fc5780e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:18.381774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea1340-9427-4c08-a3b8-8bfd8fc5780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:18.399294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c4ea1340-9427-4c08-a3b8-8bfd8fc5780e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:18.400493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c4ea1340-9427-4c08-a3b8-8bfd8fc5780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:18.408211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:18.451581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d066-c2c6-4f34-9e36-58a715db6cef None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:18.465941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d066-c2c6-4f34-9e36-58a715db6cef None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:18.471878 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53033219-aaf3-4bfc-8975-aae14e4ba96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:18.472509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53033219-aaf3-4bfc-8975-aae14e4ba96a service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:18.472794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53033219-aaf3-4bfc-8975-aae14e4ba96a service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:18.473071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53033219-aaf3-4bfc-8975-aae14e4ba96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:18.481088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53033219-aaf3-4bfc-8975-aae14e4ba96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:18.482768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53033219-aaf3-4bfc-8975-aae14e4ba96a service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:18.492663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 715/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:19.434397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bb76e-e5cb-4ee8-985a-1ace7d0c9ce7 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:19.434992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bb76e-e5cb-4ee8-985a-1ace7d0c9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:19.434992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bb76e-e5cb-4ee8-985a-1ace7d0c9ce7 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:19.436360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:19.441088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04016-7896-42c1-8d41-aab593af6788 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:19.441487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04016-7896-42c1-8d41-aab593af6788 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:19.441639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04016-7896-42c1-8d41-aab593af6788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:19.460925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-58a04016-7896-42c1-8d41-aab593af6788 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:19.462114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-58a04016-7896-42c1-8d41-aab593af6788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:19.470290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:19.631312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bb76e-e5cb-4ee8-985a-1ace7d0c9ce7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:19.645803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bb76e-e5cb-4ee8-985a-1ace7d0c9ce7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:19.651187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf1ac6-be0e-4ced-8d89-1f40a4dff2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:19.651803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf1ac6-be0e-4ced-8d89-1f40a4dff2c6 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:19.652089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf1ac6-be0e-4ced-8d89-1f40a4dff2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:19.652365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf1ac6-be0e-4ced-8d89-1f40a4dff2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:19.661220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf1ac6-be0e-4ced-8d89-1f40a4dff2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:19.662819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf1ac6-be0e-4ced-8d89-1f40a4dff2c6 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:19.672250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 703/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:20.602489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d780d1c-db18-42d2-93af-86cc21408c68 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:20.603081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d780d1c-db18-42d2-93af-86cc21408c68 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:20.603081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d780d1c-db18-42d2-93af-86cc21408c68 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:20.604473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:20.609262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abc8e-72d6-40b1-bcf8-5fd6c1451da5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:20.609658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abc8e-72d6-40b1-bcf8-5fd6c1451da5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:20.609819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abc8e-72d6-40b1-bcf8-5fd6c1451da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:20.628178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b66abc8e-72d6-40b1-bcf8-5fd6c1451da5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:20.629374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b66abc8e-72d6-40b1-bcf8-5fd6c1451da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:20.637121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:20.787941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d780d1c-db18-42d2-93af-86cc21408c68 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:20.801931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d780d1c-db18-42d2-93af-86cc21408c68 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:20.807508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe1af-e72f-4053-9b1e-58bdaa7e8d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:20.808148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe1af-e72f-4053-9b1e-58bdaa7e8d77 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:20.808460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe1af-e72f-4053-9b1e-58bdaa7e8d77 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:20.808739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe1af-e72f-4053-9b1e-58bdaa7e8d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:20.817606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe1af-e72f-4053-9b1e-58bdaa7e8d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:20.819276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe1af-e72f-4053-9b1e-58bdaa7e8d77 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:20.829243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 718/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:21.728223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816da5c6-335a-4276-83e6-189fb2f7ee0f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:21.728762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816da5c6-335a-4276-83e6-189fb2f7ee0f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:21.728762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816da5c6-335a-4276-83e6-189fb2f7ee0f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:21.730191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:21.735120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea9fc-a9be-4ab3-842f-d5824dd1c6ee None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:21.735543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea9fc-a9be-4ab3-842f-d5824dd1c6ee None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:21.735662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea9fc-a9be-4ab3-842f-d5824dd1c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:21.753626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-450ea9fc-a9be-4ab3-842f-d5824dd1c6ee None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:21.754850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-450ea9fc-a9be-4ab3-842f-d5824dd1c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:21.762426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:21.911432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816da5c6-335a-4276-83e6-189fb2f7ee0f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:21.925993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816da5c6-335a-4276-83e6-189fb2f7ee0f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:21.931258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405859f5-a0c9-469d-8736-cc98f8d774e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:21.931883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405859f5-a0c9-469d-8736-cc98f8d774e8 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:21.932169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405859f5-a0c9-469d-8736-cc98f8d774e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:21.932444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405859f5-a0c9-469d-8736-cc98f8d774e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:21.940948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405859f5-a0c9-469d-8736-cc98f8d774e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:21.942650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405859f5-a0c9-469d-8736-cc98f8d774e8 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:21.951991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 706/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:22.865184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec4830-69fd-409c-a879-ea45a2e455f2 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:22.865741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec4830-69fd-409c-a879-ea45a2e455f2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:22.865741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec4830-69fd-409c-a879-ea45a2e455f2 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:22.867149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:22.871920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bf6dc-72f2-40dc-84ad-ff4849c20ac4 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:22.872347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bf6dc-72f2-40dc-84ad-ff4849c20ac4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:22.872462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bf6dc-72f2-40dc-84ad-ff4849c20ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:22.891168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d78bf6dc-72f2-40dc-84ad-ff4849c20ac4 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:22.892357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d78bf6dc-72f2-40dc-84ad-ff4849c20ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:22.900010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:23.049613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec4830-69fd-409c-a879-ea45a2e455f2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:23.064152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec4830-69fd-409c-a879-ea45a2e455f2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:23.069446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baaf65-33eb-4bb2-8308-66dc0fb3e5cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:23.070084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaf65-33eb-4bb2-8308-66dc0fb3e5cc service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:23.070344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaf65-33eb-4bb2-8308-66dc0fb3e5cc service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:23.070645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baaf65-33eb-4bb2-8308-66dc0fb3e5cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:23.078610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baaf65-33eb-4bb2-8308-66dc0fb3e5cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:23.080178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baaf65-33eb-4bb2-8308-66dc0fb3e5cc service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:23.089492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 721/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:24.008865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8441693-bc9b-47ea-9fa9-4d2612d842a3 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:24.009417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8441693-bc9b-47ea-9fa9-4d2612d842a3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:24.009417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8441693-bc9b-47ea-9fa9-4d2612d842a3 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:24.010787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:24.016114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310aa1-5b97-4930-b957-2deda223903d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:24.016539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310aa1-5b97-4930-b957-2deda223903d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:24.016650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310aa1-5b97-4930-b957-2deda223903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:24.034678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e3310aa1-5b97-4930-b957-2deda223903d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:24.035856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e3310aa1-5b97-4930-b957-2deda223903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:24.043476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:24.192887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8441693-bc9b-47ea-9fa9-4d2612d842a3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:24.207648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8441693-bc9b-47ea-9fa9-4d2612d842a3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:24.213261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5047-7a41-47aa-b98c-808a46806d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:24.213923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5047-7a41-47aa-b98c-808a46806d00 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:24.214209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5047-7a41-47aa-b98c-808a46806d00 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:24.214484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5047-7a41-47aa-b98c-808a46806d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:24.222477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c5047-7a41-47aa-b98c-808a46806d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:24.224099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c5047-7a41-47aa-b98c-808a46806d00 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:24.233312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 709/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:25.163703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046f56b-5aa2-4f7a-9396-c6dbc718eda6 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:25.164234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046f56b-5aa2-4f7a-9396-c6dbc718eda6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:25.164234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046f56b-5aa2-4f7a-9396-c6dbc718eda6 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:25.165544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:25.170295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f0ea-c428-46d5-a716-cc854e8cba85 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:25.170759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f0ea-c428-46d5-a716-cc854e8cba85 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:25.170912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f0ea-c428-46d5-a716-cc854e8cba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:25.188891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2cf8f0ea-c428-46d5-a716-cc854e8cba85 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:25.190080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2cf8f0ea-c428-46d5-a716-cc854e8cba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:25.197779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:25.349974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046f56b-5aa2-4f7a-9396-c6dbc718eda6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:25.363828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046f56b-5aa2-4f7a-9396-c6dbc718eda6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:25.369100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d7018-1ef7-43b6-9851-89fb92a0af56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:25.369718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7018-1ef7-43b6-9851-89fb92a0af56 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:25.370000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7018-1ef7-43b6-9851-89fb92a0af56 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:25.370273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7018-1ef7-43b6-9851-89fb92a0af56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:25.378108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d7018-1ef7-43b6-9851-89fb92a0af56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:25.379696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d7018-1ef7-43b6-9851-89fb92a0af56 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:25.388738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 724/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:26.341708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfa60b-771f-4eba-9967-0b2197bcfeb3 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:26.342311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfa60b-771f-4eba-9967-0b2197bcfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:26.342311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfa60b-771f-4eba-9967-0b2197bcfeb3 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:26.344173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:26.349115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ff1c9-2254-4525-9123-67ea1a3c7d7e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:26.349497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ff1c9-2254-4525-9123-67ea1a3c7d7e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:26.350128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ff1c9-2254-4525-9123-67ea1a3c7d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:26.368004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-bd9ff1c9-2254-4525-9123-67ea1a3c7d7e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:26.372972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bd9ff1c9-2254-4525-9123-67ea1a3c7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:26.377416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:26.530170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfa60b-771f-4eba-9967-0b2197bcfeb3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:26.544899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfa60b-771f-4eba-9967-0b2197bcfeb3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:26.550850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6d39-0ad8-41d8-be52-d3468f35bdf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:26.551471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6d39-0ad8-41d8-be52-d3468f35bdf3 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:26.551752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6d39-0ad8-41d8-be52-d3468f35bdf3 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:26.552025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6d39-0ad8-41d8-be52-d3468f35bdf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:26.559955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6d39-0ad8-41d8-be52-d3468f35bdf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:26.561502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6d39-0ad8-41d8-be52-d3468f35bdf3 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:26.570783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 712/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:27.466328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066781d-7674-4abd-b67e-0798109ee267 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:27.466928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066781d-7674-4abd-b67e-0798109ee267 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:27.466928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066781d-7674-4abd-b67e-0798109ee267 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:27.468297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:49:27.473168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2f03-9bb3-48ed-b9b9-4b4fa8a3ee69 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:27.473607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2f03-9bb3-48ed-b9b9-4b4fa8a3ee69 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:27.473715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff2f03-9bb3-48ed-b9b9-4b4fa8a3ee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:27.491587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c5ff2f03-9bb3-48ed-b9b9-4b4fa8a3ee69 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:27.492765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c5ff2f03-9bb3-48ed-b9b9-4b4fa8a3ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:27.501039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:27.648309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066781d-7674-4abd-b67e-0798109ee267 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:27.662216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066781d-7674-4abd-b67e-0798109ee267 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:27.667522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fe448-0546-463f-b243-6c7b26a3116d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:27.668125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe448-0546-463f-b243-6c7b26a3116d service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:27.668407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe448-0546-463f-b243-6c7b26a3116d service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:27.668679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe448-0546-463f-b243-6c7b26a3116d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:27.677072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fe448-0546-463f-b243-6c7b26a3116d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:27.678664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fe448-0546-463f-b243-6c7b26a3116d service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:27.688321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 727/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:49:29.704023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137bf00-a58d-457c-bfe5-973e893e9483 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:29.704590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137bf00-a58d-457c-bfe5-973e893e9483 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:29.704590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137bf00-a58d-457c-bfe5-973e893e9483 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:29.705947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:29.711660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578a850-7e63-40ab-8377-302e3ab78391 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:29.712075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578a850-7e63-40ab-8377-302e3ab78391 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:29.712235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578a850-7e63-40ab-8377-302e3ab78391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:29.730119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d578a850-7e63-40ab-8377-302e3ab78391 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:29.731426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d578a850-7e63-40ab-8377-302e3ab78391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:29.739301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:29.776991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137bf00-a58d-457c-bfe5-973e893e9483 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:29.788366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137bf00-a58d-457c-bfe5-973e893e9483 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:29.791864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ed516-62ad-4c3a-88ed-e5ff0339f28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:29.792485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ed516-62ad-4c3a-88ed-e5ff0339f28a service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:29.792764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ed516-62ad-4c3a-88ed-e5ff0339f28a service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:29.793034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ed516-62ad-4c3a-88ed-e5ff0339f28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:29.802061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ed516-62ad-4c3a-88ed-e5ff0339f28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:29.803510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ed516-62ad-4c3a-88ed-e5ff0339f28a service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:29.812758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 715/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:32.152042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14dc5f-4224-460c-a004-dc90c5693ac0 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:32.152568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14dc5f-4224-460c-a004-dc90c5693ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:32.152568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14dc5f-4224-460c-a004-dc90c5693ac0 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:32.153910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:32.159762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5212a0-5197-408f-8540-a3b9fff656de None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:32.160208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5212a0-5197-408f-8540-a3b9fff656de None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:32.160312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5212a0-5197-408f-8540-a3b9fff656de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:32.177828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2c5212a0-5197-408f-8540-a3b9fff656de None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:32.179154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2c5212a0-5197-408f-8540-a3b9fff656de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:32.187121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:32.227185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14dc5f-4224-460c-a004-dc90c5693ac0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:32.241333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14dc5f-4224-460c-a004-dc90c5693ac0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:32.244887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58860-1302-4576-a734-3f2287139199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:32.245491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58860-1302-4576-a734-3f2287139199 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:32.250114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58860-1302-4576-a734-3f2287139199 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:32.250114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58860-1302-4576-a734-3f2287139199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:32.256004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58860-1302-4576-a734-3f2287139199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:32.257432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58860-1302-4576-a734-3f2287139199 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:32.267648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 730/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:34.725282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf766-6803-4ee1-8e79-2c32f545c04c None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:34.725859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf766-6803-4ee1-8e79-2c32f545c04c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:34.725859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf766-6803-4ee1-8e79-2c32f545c04c None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:34.727282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:34.732339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9db6-13c3-4a39-8c11-490c0f12e766 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:34.732756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9db6-13c3-4a39-8c11-490c0f12e766 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:34.732891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9db6-13c3-4a39-8c11-490c0f12e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:34.750064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1a9f9db6-13c3-4a39-8c11-490c0f12e766 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:34.751279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1a9f9db6-13c3-4a39-8c11-490c0f12e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:34.759010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:34.796965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf766-6803-4ee1-8e79-2c32f545c04c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:34.807509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf766-6803-4ee1-8e79-2c32f545c04c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:34.811020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4952d3-2c7a-4420-8caf-dd75b14db286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:34.811677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4952d3-2c7a-4420-8caf-dd75b14db286 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:34.811961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4952d3-2c7a-4420-8caf-dd75b14db286 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:34.812238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4952d3-2c7a-4420-8caf-dd75b14db286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:34.821493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4952d3-2c7a-4420-8caf-dd75b14db286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:34.822943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4952d3-2c7a-4420-8caf-dd75b14db286 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:34.832742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 718/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:49:37.189491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d2d8-9d8c-4472-97e8-1a49a5cd921e None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:37.190010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d2d8-9d8c-4472-97e8-1a49a5cd921e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:37.190010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d2d8-9d8c-4472-97e8-1a49a5cd921e None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:37.191413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:37.196714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c495-fb46-4c4b-b1cd-997bebfa1899 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:37.197131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c495-fb46-4c4b-b1cd-997bebfa1899 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:37.197263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c495-fb46-4c4b-b1cd-997bebfa1899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:37.214621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c339c495-fb46-4c4b-b1cd-997bebfa1899 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:37.215803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c339c495-fb46-4c4b-b1cd-997bebfa1899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:37.223905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:49:37.263030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d2d8-9d8c-4472-97e8-1a49a5cd921e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:37.265273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e0d3d2d8-9d8c-4472-97e8-1a49a5cd921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:37.278062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d2d8-9d8c-4472-97e8-1a49a5cd921e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:37.281531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1327cc7-dc11-4aa5-b660-50eef93bb6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:37.282149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1327cc7-dc11-4aa5-b660-50eef93bb6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:37.282428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1327cc7-dc11-4aa5-b660-50eef93bb6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:37.282733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1327cc7-dc11-4aa5-b660-50eef93bb6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:37.291328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1327cc7-dc11-4aa5-b660-50eef93bb6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:37.292734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1327cc7-dc11-4aa5-b660-50eef93bb6a6 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:37.301884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 733/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:39.527395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d570052-5545-4c40-9d1b-5eb2d15cd414 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:39.527950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d570052-5545-4c40-9d1b-5eb2d15cd414 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:39.527950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d570052-5545-4c40-9d1b-5eb2d15cd414 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:39.529296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:39.534534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9e02-855c-4d30-8f27-244ac889c6d4 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:39.545769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9e02-855c-4d30-8f27-244ac889c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:39.545769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9e02-855c-4d30-8f27-244ac889c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:39.552255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-da3d9e02-855c-4d30-8f27-244ac889c6d4 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:39.553446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-da3d9e02-855c-4d30-8f27-244ac889c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:39.561128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:49:39.599066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d570052-5545-4c40-9d1b-5eb2d15cd414 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:39.609710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d570052-5545-4c40-9d1b-5eb2d15cd414 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:39.613174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862b93-3ea1-42c2-83bb-b3c76b863ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:39.613804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862b93-3ea1-42c2-83bb-b3c76b863ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:39.614112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862b93-3ea1-42c2-83bb-b3c76b863ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:39.614387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862b93-3ea1-42c2-83bb-b3c76b863ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:39.623166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862b93-3ea1-42c2-83bb-b3c76b863ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:39.625083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862b93-3ea1-42c2-83bb-b3c76b863ac2 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:39.634310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 721/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:41.797653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ed241-d556-4d6f-8483-4caf7ccbfd58 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:41.798238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ed241-d556-4d6f-8483-4caf7ccbfd58 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:41.798238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ed241-d556-4d6f-8483-4caf7ccbfd58 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:41.799606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:41.804632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524918-2448-4a5a-9045-72064346d21d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:41.805079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524918-2448-4a5a-9045-72064346d21d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:41.805177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524918-2448-4a5a-9045-72064346d21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:41.823105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f8524918-2448-4a5a-9045-72064346d21d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:41.824306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f8524918-2448-4a5a-9045-72064346d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:41.832969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:41.870036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ed241-d556-4d6f-8483-4caf7ccbfd58 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:41.881256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ed241-d556-4d6f-8483-4caf7ccbfd58 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:41.884762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98f704-7b72-4da3-aa9c-703c8d91094e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:41.885384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98f704-7b72-4da3-aa9c-703c8d91094e service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:41.885661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98f704-7b72-4da3-aa9c-703c8d91094e service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:41.885930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98f704-7b72-4da3-aa9c-703c8d91094e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:41.895502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98f704-7b72-4da3-aa9c-703c8d91094e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:41.896912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98f704-7b72-4da3-aa9c-703c8d91094e service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:41.906025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 736/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:44.074955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6191-5afa-41f3-81ee-a4dce217035b None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:44.075547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6191-5afa-41f3-81ee-a4dce217035b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:44.075547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6191-5afa-41f3-81ee-a4dce217035b None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:44.076879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:44.082053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3c69-72b0-4114-9648-40a678405495 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:44.082495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3c69-72b0-4114-9648-40a678405495 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:44.082666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3c69-72b0-4114-9648-40a678405495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:44.089050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=70 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:49:44.101335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-565d3c69-72b0-4114-9648-40a678405495 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:44.107401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-565d3c69-72b0-4114-9648-40a678405495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:44.110836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:44.146760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6191-5afa-41f3-81ee-a4dce217035b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:44.152063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=73 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:49:44.158150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6191-5afa-41f3-81ee-a4dce217035b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:44.164730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82224434-64fd-4ba0-b766-88a0bf98c25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:44.164730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82224434-64fd-4ba0-b766-88a0bf98c25e service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:44.164730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82224434-64fd-4ba0-b766-88a0bf98c25e service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:44.164730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82224434-64fd-4ba0-b766-88a0bf98c25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:44.172305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82224434-64fd-4ba0-b766-88a0bf98c25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:44.173755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82224434-64fd-4ba0-b766-88a0bf98c25e service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:44.183443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 724/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:46.370220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd47e4-a979-48c6-af1c-d788b8ca5643 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:46.370835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd47e4-a979-48c6-af1c-d788b8ca5643 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:46.370835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd47e4-a979-48c6-af1c-d788b8ca5643 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:46.372232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:46.378172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31640-506c-4fa3-98f8-76206f892f91 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:46.378649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31640-506c-4fa3-98f8-76206f892f91 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:46.378772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31640-506c-4fa3-98f8-76206f892f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:46.396299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8bd31640-506c-4fa3-98f8-76206f892f91 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:46.397477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8bd31640-506c-4fa3-98f8-76206f892f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:46.405006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:46.441955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd47e4-a979-48c6-af1c-d788b8ca5643 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:46.453183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd47e4-a979-48c6-af1c-d788b8ca5643 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:46.456739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518604-0439-43ef-b5b1-5542f2779d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:46.457375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518604-0439-43ef-b5b1-5542f2779d33 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:46.457660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518604-0439-43ef-b5b1-5542f2779d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:46.457937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518604-0439-43ef-b5b1-5542f2779d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:46.467116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518604-0439-43ef-b5b1-5542f2779d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:46.468576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518604-0439-43ef-b5b1-5542f2779d33 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:46.477836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 739/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:48.596966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cb679-8609-487b-a601-e97cd7d90103 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:48.597521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cb679-8609-487b-a601-e97cd7d90103 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:48.597521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cb679-8609-487b-a601-e97cd7d90103 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:48.598935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:48.604240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8dd44-ac45-43be-b143-f8a9a9e43452 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:48.604672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8dd44-ac45-43be-b143-f8a9a9e43452 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:48.604790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8dd44-ac45-43be-b143-f8a9a9e43452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:48.622379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-48c8dd44-ac45-43be-b143-f8a9a9e43452 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:48.623525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-48c8dd44-ac45-43be-b143-f8a9a9e43452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:48.631139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:48.669025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cb679-8609-487b-a601-e97cd7d90103 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:48.680287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cb679-8609-487b-a601-e97cd7d90103 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:48.683827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de6b90-2cf2-4ccb-8865-67685ed711c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:48.684471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6b90-2cf2-4ccb-8865-67685ed711c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:48.684753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6b90-2cf2-4ccb-8865-67685ed711c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:48.685029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6b90-2cf2-4ccb-8865-67685ed711c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:48.693781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de6b90-2cf2-4ccb-8865-67685ed711c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:48.695231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de6b90-2cf2-4ccb-8865-67685ed711c3 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:48.704468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 727/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:49:50.835303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845239-3a99-4fa1-b6bd-20807d057fec None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:50.835890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845239-3a99-4fa1-b6bd-20807d057fec None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:50.835890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845239-3a99-4fa1-b6bd-20807d057fec None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:50.837225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:49:50.842413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff118cd-4f7d-40fb-b2c3-23ce311a7cf9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:50.843391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff118cd-4f7d-40fb-b2c3-23ce311a7cf9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:50.843564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff118cd-4f7d-40fb-b2c3-23ce311a7cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:50.861660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8ff118cd-4f7d-40fb-b2c3-23ce311a7cf9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:49:50.862888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8ff118cd-4f7d-40fb-b2c3-23ce311a7cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:49:50.870690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:49:50.906312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845239-3a99-4fa1-b6bd-20807d057fec None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:49:50.917133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845239-3a99-4fa1-b6bd-20807d057fec None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:49:50.920670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43dca9-3932-4291-8c97-7fb01aafa7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:49:50.921986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43dca9-3932-4291-8c97-7fb01aafa7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:49:50.922274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43dca9-3932-4291-8c97-7fb01aafa7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:49:50.922550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43dca9-3932-4291-8c97-7fb01aafa7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:49:50.931352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43dca9-3932-4291-8c97-7fb01aafa7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:49:50.932765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43dca9-3932-4291-8c97-7fb01aafa7c9 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:49:50.942495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 742/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:50:00.855829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=17 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:50:00.938405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=17 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:50:10.947761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76473aac-b89f-485a-ae95-9f88b07d6764 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:10.948319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76473aac-b89f-485a-ae95-9f88b07d6764 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:10.948319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76473aac-b89f-485a-ae95-9f88b07d6764 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:10.949677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 729/1471] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:10.954822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9eef5-97a5-4999-9c87-9b9681f46561 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:10.955228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9eef5-97a5-4999-9c87-9b9681f46561 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:10.955391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9eef5-97a5-4999-9c87-9b9681f46561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:10.973243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1eb9eef5-97a5-4999-9c87-9b9681f46561 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:10.974441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1eb9eef5-97a5-4999-9c87-9b9681f46561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:10.982135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 743/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:50:11.028185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a85a-918c-4e0d-91f7-cb1202dc7eff None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:11.028503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a85a-918c-4e0d-91f7-cb1202dc7eff None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:11.028805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a85a-918c-4e0d-91f7-cb1202dc7eff None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:11.030669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 730/1473] 10.222.0.36 () {54 vars in 962 bytes} [Thu Jun 16 11:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:11.035444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2f28-a3d2-491f-8c87-021d78976b16 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:11.035741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2f28-a3d2-491f-8c87-021d78976b16 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:11.036026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2f28-a3d2-491f-8c87-021d78976b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:11.054110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4c3a2f28-a3d2-491f-8c87-021d78976b16 None None] MFA Rules not processed for user `14349e981de34943823081c4470cea88`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:11.055334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4c3a2f28-a3d2-491f-8c87-021d78976b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:11.061715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 744/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Jun 16 11:50:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:50:11.068858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a85a-918c-4e0d-91f7-cb1202dc7eff None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:11.079277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a85a-918c-4e0d-91f7-cb1202dc7eff None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:11.082867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610480-767a-4b5f-8156-710517d7e377 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:11.083495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610480-767a-4b5f-8156-710517d7e377 service glance] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:11.083782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610480-767a-4b5f-8156-710517d7e377 service glance] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:11.084057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610480-767a-4b5f-8156-710517d7e377 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:11.093896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610480-767a-4b5f-8156-710517d7e377 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:11.095363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610480-767a-4b5f-8156-710517d7e377 service glance] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:11.104522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 731/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:50:13.330666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185877f-671a-42da-a8a0-21ef05ec94b5 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:13.331204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185877f-671a-42da-a8a0-21ef05ec94b5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:13.331400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185877f-671a-42da-a8a0-21ef05ec94b5 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:13.332612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 745/1476] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:50:13.338051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f27e-988d-449e-8555-2b7d27fd7324 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:13.338489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f27e-988d-449e-8555-2b7d27fd7324 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:13.338623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f27e-988d-449e-8555-2b7d27fd7324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:13.356243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-abc2f27e-988d-449e-8555-2b7d27fd7324 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:13.357442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-abc2f27e-988d-449e-8555-2b7d27fd7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:13.365102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 732/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:50:13.388940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185877f-671a-42da-a8a0-21ef05ec94b5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:13.401960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185877f-671a-42da-a8a0-21ef05ec94b5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:13.406396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:13.407070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:13.407353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:13.407629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:13.408356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:13.410118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:50:13.410118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:50:13.410118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:50:13.411355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b724cca-a794-4f29-bd37-8c7678de6540 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:13.429721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 746/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jun 16 11:50:13 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:50:15.581463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f37dcf-340e-439e-8868-b8b341cc7b32 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:15.582011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f37dcf-340e-439e-8868-b8b341cc7b32 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:15.582011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f37dcf-340e-439e-8868-b8b341cc7b32 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:15.583428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 733/1479] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:15.588806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53be09-387b-4905-96be-37b5da1dd8b2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:15.589247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53be09-387b-4905-96be-37b5da1dd8b2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:15.589374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53be09-387b-4905-96be-37b5da1dd8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:15.608950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-eb53be09-387b-4905-96be-37b5da1dd8b2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:15.610101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-eb53be09-387b-4905-96be-37b5da1dd8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:15.617865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 747/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:50:15.660760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f37dcf-340e-439e-8868-b8b341cc7b32 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:15.683824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f37dcf-340e-439e-8868-b8b341cc7b32 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:15.689871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c3656-4a7f-4dd7-b240-13446b407cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:15.690919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c3656-4a7f-4dd7-b240-13446b407cee service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:15.690919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c3656-4a7f-4dd7-b240-13446b407cee service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:15.691172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c3656-4a7f-4dd7-b240-13446b407cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:15.699686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c3656-4a7f-4dd7-b240-13446b407cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:15.701321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c3656-4a7f-4dd7-b240-13446b407cee service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:15.711910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 734/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:50:18.015591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be5745-8910-4cfb-86fd-85770986d386 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:18.016160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be5745-8910-4cfb-86fd-85770986d386 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:18.016160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be5745-8910-4cfb-86fd-85770986d386 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:18.017766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 748/1482] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:18.023061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36c67-6658-470f-ac23-36fc68e06f55 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:18.023480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36c67-6658-470f-ac23-36fc68e06f55 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:18.023621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36c67-6658-470f-ac23-36fc68e06f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:18.040687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1df36c67-6658-470f-ac23-36fc68e06f55 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:18.041971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1df36c67-6658-470f-ac23-36fc68e06f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:18.049907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 735/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:50:18.086852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be5745-8910-4cfb-86fd-85770986d386 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:18.097768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be5745-8910-4cfb-86fd-85770986d386 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:18.101264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f3f9-9f45-4139-874f-b1ca6b890885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:18.101898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f3f9-9f45-4139-874f-b1ca6b890885 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:18.102189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f3f9-9f45-4139-874f-b1ca6b890885 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:18.102468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f3f9-9f45-4139-874f-b1ca6b890885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:18.112046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f3f9-9f45-4139-874f-b1ca6b890885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:18.113805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f3f9-9f45-4139-874f-b1ca6b890885 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:18.123248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 749/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:50:20.260451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a7b6-1993-4d6a-b8a9-6168846a66ef None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:20.260972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a7b6-1993-4d6a-b8a9-6168846a66ef None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:20.260972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a7b6-1993-4d6a-b8a9-6168846a66ef None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:20.262387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 736/1485] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:20.268028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337cb6-190c-4bbd-82d9-5d1ecaa4915e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:20.268416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337cb6-190c-4bbd-82d9-5d1ecaa4915e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:20.268579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c337cb6-190c-4bbd-82d9-5d1ecaa4915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:20.285592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2c337cb6-190c-4bbd-82d9-5d1ecaa4915e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:20.286810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2c337cb6-190c-4bbd-82d9-5d1ecaa4915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:20.294797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 750/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:50:20.332298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a7b6-1993-4d6a-b8a9-6168846a66ef None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:20.343104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a7b6-1993-4d6a-b8a9-6168846a66ef None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:20.346573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155009c-52a8-42c7-88a2-6f2c78a65076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:20.347227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155009c-52a8-42c7-88a2-6f2c78a65076 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:20.347511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155009c-52a8-42c7-88a2-6f2c78a65076 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:20.347793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155009c-52a8-42c7-88a2-6f2c78a65076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:20.356607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155009c-52a8-42c7-88a2-6f2c78a65076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:20.358031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155009c-52a8-42c7-88a2-6f2c78a65076 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:20.368396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 737/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:50:22.638246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8418d-c446-4fd3-8615-d4cbd5f78a35 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:22.638879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8418d-c446-4fd3-8615-d4cbd5f78a35 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:22.638879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8418d-c446-4fd3-8615-d4cbd5f78a35 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:22.640206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 751/1488] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:22.645348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf88969-60d7-4295-b4a2-b8196f746346 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:22.645754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf88969-60d7-4295-b4a2-b8196f746346 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:22.646002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf88969-60d7-4295-b4a2-b8196f746346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:22.663256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-fcf88969-60d7-4295-b4a2-b8196f746346 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:22.664433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-fcf88969-60d7-4295-b4a2-b8196f746346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:22.672620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 738/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:50:22.712238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8418d-c446-4fd3-8615-d4cbd5f78a35 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:22.722812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8418d-c446-4fd3-8615-d4cbd5f78a35 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:22.726260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b311-fa91-40e5-b80e-4d04dab81822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:22.726913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b311-fa91-40e5-b80e-4d04dab81822 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:22.727195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b311-fa91-40e5-b80e-4d04dab81822 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:22.727470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b311-fa91-40e5-b80e-4d04dab81822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:22.736588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b311-fa91-40e5-b80e-4d04dab81822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:22.738001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b311-fa91-40e5-b80e-4d04dab81822 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:22.747185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 752/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:50:25.248461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bf2f9-b3b5-4340-87fc-0cdeeb3771af None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:25.249492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bf2f9-b3b5-4340-87fc-0cdeeb3771af None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:25.249492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bf2f9-b3b5-4340-87fc-0cdeeb3771af None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:25.250905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 739/1491] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jun 16 11:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:50:25.255990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6e29b-d8d5-4ca3-a6e7-6f87775fbc4d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:25.256404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6e29b-d8d5-4ca3-a6e7-6f87775fbc4d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:25.256552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6e29b-d8d5-4ca3-a6e7-6f87775fbc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:25.274346 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4fe6e29b-d8d5-4ca3-a6e7-6f87775fbc4d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:50:25.275572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4fe6e29b-d8d5-4ca3-a6e7-6f87775fbc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:50:25.283331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 753/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jun 16 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:50:25.320757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bf2f9-b3b5-4340-87fc-0cdeeb3771af None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:50:25.331744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bf2f9-b3b5-4340-87fc-0cdeeb3771af None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:50:25.335215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cfc04-7437-4304-b776-7f1153c82cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:50:25.336095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cfc04-7437-4304-b776-7f1153c82cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:50:25.336390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cfc04-7437-4304-b776-7f1153c82cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:50:25.336649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cfc04-7437-4304-b776-7f1153c82cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:50:25.345353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cfc04-7437-4304-b776-7f1153c82cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:50:25.346791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cfc04-7437-4304-b776-7f1153c82cb1 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:50:25.355974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 740/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:50:35.269370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=33 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:50:35.351878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=33 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:52:20.743759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:20.744384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:20.744384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:20.761722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:52:20.762924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:20.770515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 754/1494] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:52:20.779510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:20.779993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:20.780096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:20.798918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:52:20.800086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:20.807637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 741/1495] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:52:20.811957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:20.821211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85e0f0-6f41-49eb-aa39-345fa8af40d0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:20.825586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:20.826222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:20.826499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:20.826798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:20.827516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:52:20.827853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:20.828854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:20.828854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:52:20.828854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:52:20.829737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:20.841123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 755/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:52:20.849338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:20.858398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cc063-8394-4ce6-8280-6387efd2567d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:20.863519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:20.864163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:20.864441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:20.864712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:20.865403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:20.867185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:20.867185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:52:20.867185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:52:20.868357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:20.977207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 742/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:52:20 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:52:20.981470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:20.992175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ae97e-a216-4694-97b5-6a04e518bb91 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:21.046049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:21.047335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.047621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.047908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.048596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:21.049605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:21.049605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:52:21.049605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:52:21.050826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:21.169253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 756/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:52:20 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:52:21.173389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:21.183643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c71c4-2bc6-49ed-9e49-98d8803f3a15 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:21.188160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:52:21.191153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:52:21.192050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:21.205232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 743/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:52:21.209094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:21.219843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e9d8-c94f-484b-aca1-7b0ecac1e92f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:21.224564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:21.225201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.225486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.225764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.226493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:21.227533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:21.227533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:52:21.227533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:52:21.228413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86025f-e12a-4c0c-9921-7de1397b53f3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:21.241549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 757/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:52:21.245472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:21.255285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678430f0-e5ea-48dc-b8ac-45f534c431d5 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:21.259732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:21.260603 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.260886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.261162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] PATH_INFO: `/v3/projects/3ce062840a9f4b45862278a4dbbd2dd6/users/23e3c96a6e5c4e1e9fff83be12283234/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.276247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce062840a9f4b45862278a4dbbd2dd6, user_id=23e3c96a6e5c4e1e9fff83be12283234, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:21.277278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:21.277278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:52:21.277278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:52:21.279255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4c2b-d34d-4a44-8670-02c5ee132f96 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:21.341525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 744/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:52:21 2022] PUT /identity/v3/projects/3ce062840a9f4b45862278a4dbbd2dd6/users/23e3c96a6e5c4e1e9fff83be12283234/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:52:21.354360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6e16f-01f0-47dc-8e5b-b8b1e31e72b6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.354692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6e16f-01f0-47dc-8e5b-b8b1e31e72b6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.354977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6e16f-01f0-47dc-8e5b-b8b1e31e72b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.380121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-eda6e16f-01f0-47dc-8e5b-b8b1e31e72b6 None None] MFA Rules not processed for user `23e3c96a6e5c4e1e9fff83be12283234`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:52:21.381316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-eda6e16f-01f0-47dc-8e5b-b8b1e31e72b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:21.442464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 758/1502] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:52:21.456523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4317f-58d1-43d5-a611-c01b4009172a None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.456815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4317f-58d1-43d5-a611-c01b4009172a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.457096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4317f-58d1-43d5-a611-c01b4009172a None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.458496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 745/1503] 10.222.0.36 () {54 vars in 963 bytes} [Thu Jun 16 11:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:52:21.464097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f310-6947-41f0-b406-648941db7c22 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.464392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f310-6947-41f0-b406-648941db7c22 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.464676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f310-6947-41f0-b406-648941db7c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.483249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9424f310-6947-41f0-b406-648941db7c22 None None] MFA Rules not processed for user `8dd8663dd0584d859bfb3268355f6a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:52:21.484511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9424f310-6947-41f0-b406-648941db7c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:21.533419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:52:21.541863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 759/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Thu Jun 16 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:52:21.549944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4317f-58d1-43d5-a611-c01b4009172a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:21.560937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4317f-58d1-43d5-a611-c01b4009172a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:21.565116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:21.565765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.566045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.566318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.576291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:21.580454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:21.588145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 746/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:52:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:52:21.631249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c3008-6904-43a5-b831-accb1e365954 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.631542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c3008-6904-43a5-b831-accb1e365954 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.631822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c3008-6904-43a5-b831-accb1e365954 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.633432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 760/1506] 10.222.0.36 () {52 vars in 829 bytes} [Thu Jun 16 11:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:52:21.637472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:21.699553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a48de-128d-4738-8dc0-ade1a9f1a248 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:21.704698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:21.705592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:21.705874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:21.706148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] PATH_INFO: `/v3/users/23e3c96a6e5c4e1e9fff83be12283234` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:21.707347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e3c96a6e5c4e1e9fff83be12283234)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:21.708350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:21.708350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:52:21.708350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:52:21.709544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:22.010154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e3c96a6e5c4e1e9fff83be12283234'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.010901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e3c96a6e5c4e1e9fff83be12283234'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.022996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e3c96a6e5c4e1e9fff83be12283234'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.089111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e3c96a6e5c4e1e9fff83be12283234'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.105038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:52:22.107185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e3c96a6e5c4e1e9fff83be12283234'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.113619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 747/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:52:21 2022] DELETE /identity/v3/users/23e3c96a6e5c4e1e9fff83be12283234 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:52:22.118008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:22.118461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:22.118555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:22.136118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:52:22.137264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:22.194076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 761/1508] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:52:22.203421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:22.204803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:22.263376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036dc47-3707-40cf-807a-59df316016b4 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:22.267292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da59e0-b612-453f-aecf-aa7ea218feaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:22.267935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da59e0-b612-453f-aecf-aa7ea218feaa service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:22.268215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da59e0-b612-453f-aecf-aa7ea218feaa service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:22.268488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da59e0-b612-453f-aecf-aa7ea218feaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:22.277258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da59e0-b612-453f-aecf-aa7ea218feaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:22.278690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da59e0-b612-453f-aecf-aa7ea218feaa service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:22.288315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 748/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:52:22.763356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:52:22.764830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:52:22.777616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29453-9521-4e7f-bf8f-5d004f8d2eba None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:52:22.784066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:52:22.784927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:52:22.785209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:52:22.785487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] PATH_INFO: `/v3/projects/3ce062840a9f4b45862278a4dbbd2dd6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:52:22.787440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce062840a9f4b45862278a4dbbd2dd6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:52:22.788792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:52:22.788792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:52:22.788792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:52:22.790002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:52:22.910163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce062840a9f4b45862278a4dbbd2dd6', 'request_id': 'req-9e1495e9-2876-4970-9d4c-cc8aeb3af264'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.916539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce062840a9f4b45862278a4dbbd2dd6', 'request_id': 'req-9e1495e9-2876-4970-9d4c-cc8aeb3af264'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.972900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce062840a9f4b45862278a4dbbd2dd6', 'request_id': 'req-9e1495e9-2876-4970-9d4c-cc8aeb3af264'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.991422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] The token cache is being invalidate because project 3ce062840a9f4b45862278a4dbbd2dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:52:22.991713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.992471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9e1495e9-2876-4970-9d4c-cc8aeb3af264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:52:22.994039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 762/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:52:22 2022] DELETE /identity/v3/projects/3ce062840a9f4b45862278a4dbbd2dd6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:52:32.284427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:52:32.988402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:08.260865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed08411-ab86-4a7a-b0bc-934a64cc4f75 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:08.261460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed08411-ab86-4a7a-b0bc-934a64cc4f75 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:08.261460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed08411-ab86-4a7a-b0bc-934a64cc4f75 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:08.262762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:08.267487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9353f5-407f-4c15-8df1-cad98a2db8b5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:08.268535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9353f5-407f-4c15-8df1-cad98a2db8b5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:08.268619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9353f5-407f-4c15-8df1-cad98a2db8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:08.286344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8c9353f5-407f-4c15-8df1-cad98a2db8b5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:08.287632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8c9353f5-407f-4c15-8df1-cad98a2db8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:08.346523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:08.531238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed08411-ab86-4a7a-b0bc-934a64cc4f75 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:08.532970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-aed08411-ab86-4a7a-b0bc-934a64cc4f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:08.606531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed08411-ab86-4a7a-b0bc-934a64cc4f75 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:08.612627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ed4a4-992a-4b18-bcf3-8dbdade88242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:08.613263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed4a4-992a-4b18-bcf3-8dbdade88242 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:08.613549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed4a4-992a-4b18-bcf3-8dbdade88242 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:08.613827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed4a4-992a-4b18-bcf3-8dbdade88242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:08.621969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ed4a4-992a-4b18-bcf3-8dbdade88242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:08.623580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ed4a4-992a-4b18-bcf3-8dbdade88242 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:08.632931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 750/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:09.518035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628698-7c4a-4496-88cf-628c9fb0ca20 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:09.518645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628698-7c4a-4496-88cf-628c9fb0ca20 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:09.518645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628698-7c4a-4496-88cf-628c9fb0ca20 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:09.520107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:09.524994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfbaa-5406-41c7-918a-1bbfff4b687b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:09.525424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfbaa-5406-41c7-918a-1bbfff4b687b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:09.525563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfbaa-5406-41c7-918a-1bbfff4b687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:09.543128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-dd8dfbaa-5406-41c7-918a-1bbfff4b687b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:09.544350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dd8dfbaa-5406-41c7-918a-1bbfff4b687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:09.552677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:09.715672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628698-7c4a-4496-88cf-628c9fb0ca20 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:09.731531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628698-7c4a-4496-88cf-628c9fb0ca20 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:09.741785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d59560-384a-4f24-929b-a79eb018250a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:09.744082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59560-384a-4f24-929b-a79eb018250a service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:09.744082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59560-384a-4f24-929b-a79eb018250a service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:09.744082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59560-384a-4f24-929b-a79eb018250a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:09.753984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d59560-384a-4f24-929b-a79eb018250a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:09.755765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d59560-384a-4f24-929b-a79eb018250a service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:09.766340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 765/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:09.869770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482585e-fea3-4ee0-9222-0bdcd2ebe52d None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:09.870057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482585e-fea3-4ee0-9222-0bdcd2ebe52d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:09.870364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482585e-fea3-4ee0-9222-0bdcd2ebe52d None None] PATH_INFO: `/v3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:09.871684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 752/1517] 10.222.0.27 () {54 vars in 925 bytes} [Thu Jun 16 11:54:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:54:09.885359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a14a-463d-4018-89df-ae35bba3994f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:09.885648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a14a-463d-4018-89df-ae35bba3994f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:09.885924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a14a-463d-4018-89df-ae35bba3994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:09.904013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4e87a14a-463d-4018-89df-ae35bba3994f None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:09.905211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4e87a14a-463d-4018-89df-ae35bba3994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:09.965471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 766/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 16 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:13.960511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f23c-0d30-474f-9d21-0347c527530c None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:13.961004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f23c-0d30-474f-9d21-0347c527530c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:13.961004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f23c-0d30-474f-9d21-0347c527530c None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:13.962359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 753/1519] 10.222.0.36 () {54 vars in 960 bytes} [Thu Jun 16 11:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:13.968150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca61fae-e8ee-487b-9016-7612b68614ab None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:13.968150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca61fae-e8ee-487b-9016-7612b68614ab None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:13.968589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca61fae-e8ee-487b-9016-7612b68614ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:13.985796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3ca61fae-e8ee-487b-9016-7612b68614ab None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:13.987146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3ca61fae-e8ee-487b-9016-7612b68614ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:13.996044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 767/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Thu Jun 16 11:54:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:14.004206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f23c-0d30-474f-9d21-0347c527530c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:14.017021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f23c-0d30-474f-9d21-0347c527530c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:14.021943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09615-6e75-46f3-bd40-9e4549f251a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:14.022565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09615-6e75-46f3-bd40-9e4549f251a9 service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:14.022876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09615-6e75-46f3-bd40-9e4549f251a9 service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:14.023149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09615-6e75-46f3-bd40-9e4549f251a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:14.031215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09615-6e75-46f3-bd40-9e4549f251a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:14.032786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09615-6e75-46f3-bd40-9e4549f251a9 service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:14.042107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 754/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:21.038982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96958a12-e780-4420-98f3-d9c7230e9d77 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:21.039535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96958a12-e780-4420-98f3-d9c7230e9d77 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:21.039535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96958a12-e780-4420-98f3-d9c7230e9d77 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:21.040909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:21.045727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849fb1-fa91-44f2-b01d-af0684bc1a92 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:21.046169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849fb1-fa91-44f2-b01d-af0684bc1a92 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:21.046276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849fb1-fa91-44f2-b01d-af0684bc1a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:21.066487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-39849fb1-fa91-44f2-b01d-af0684bc1a92 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:21.067713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-39849fb1-fa91-44f2-b01d-af0684bc1a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:21.075399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:21.227256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96958a12-e780-4420-98f3-d9c7230e9d77 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:21.241676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96958a12-e780-4420-98f3-d9c7230e9d77 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:21.247045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5bbbc-8b3d-4a3a-84d6-528c0042ed5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:21.247672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5bbbc-8b3d-4a3a-84d6-528c0042ed5f service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:21.247952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5bbbc-8b3d-4a3a-84d6-528c0042ed5f service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:21.248223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5bbbc-8b3d-4a3a-84d6-528c0042ed5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:21.256171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5bbbc-8b3d-4a3a-84d6-528c0042ed5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:21.257749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5bbbc-8b3d-4a3a-84d6-528c0042ed5f service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:21.267006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 769/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:22.144086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aa1a6-adee-4955-8865-19f0a7bdac46 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:22.144607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aa1a6-adee-4955-8865-19f0a7bdac46 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:22.144607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aa1a6-adee-4955-8865-19f0a7bdac46 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:22.145946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 11:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:22.150789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b3a8-ef6e-4ddb-9d7e-af7bef7e91eb None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:22.151219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b3a8-ef6e-4ddb-9d7e-af7bef7e91eb None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:22.151337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b3a8-ef6e-4ddb-9d7e-af7bef7e91eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:22.168794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7ee0b3a8-ef6e-4ddb-9d7e-af7bef7e91eb None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:22.169982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7ee0b3a8-ef6e-4ddb-9d7e-af7bef7e91eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:22.178500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 11:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:22.328208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aa1a6-adee-4955-8865-19f0a7bdac46 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:22.342687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aa1a6-adee-4955-8865-19f0a7bdac46 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:22.348093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1286a-98ba-4ea2-9d24-64d01e3c5dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:22.348720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1286a-98ba-4ea2-9d24-64d01e3c5dff service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:22.349007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1286a-98ba-4ea2-9d24-64d01e3c5dff service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:22.349284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1286a-98ba-4ea2-9d24-64d01e3c5dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:22.357230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1286a-98ba-4ea2-9d24-64d01e3c5dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:22.358826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1286a-98ba-4ea2-9d24-64d01e3c5dff service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:22.368506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 757/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:26.511901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa38af-3fce-4b75-9831-b76127b04070 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:26.512506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa38af-3fce-4b75-9831-b76127b04070 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:26.512506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa38af-3fce-4b75-9831-b76127b04070 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:26.513845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:26.519098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577bed0-f9a6-4447-83f3-8d3aecc7f782 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:26.519537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577bed0-f9a6-4447-83f3-8d3aecc7f782 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:26.519683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577bed0-f9a6-4447-83f3-8d3aecc7f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:26.537636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3577bed0-f9a6-4447-83f3-8d3aecc7f782 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:26.538868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3577bed0-f9a6-4447-83f3-8d3aecc7f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:26.546512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:26.582887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa38af-3fce-4b75-9831-b76127b04070 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:26.584555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-32fa38af-3fce-4b75-9831-b76127b04070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:26.641569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa38af-3fce-4b75-9831-b76127b04070 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:26.649406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0554-eb01-48b5-9c70-3f89847c27f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:26.649406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0554-eb01-48b5-9c70-3f89847c27f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:26.649406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0554-eb01-48b5-9c70-3f89847c27f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:26.649406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0554-eb01-48b5-9c70-3f89847c27f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:26.655090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0554-eb01-48b5-9c70-3f89847c27f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:26.656535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0554-eb01-48b5-9c70-3f89847c27f2 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:26.661398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:26.666077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 772/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:28.781609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342602-6f49-4f2d-a29f-08bcb2cc9fac None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:28.782134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342602-6f49-4f2d-a29f-08bcb2cc9fac None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:28.782134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342602-6f49-4f2d-a29f-08bcb2cc9fac None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:28.783501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:28.788740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817a4ff-8f0b-4da9-a2e8-34d03cb5856e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:28.789167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817a4ff-8f0b-4da9-a2e8-34d03cb5856e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:28.789312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817a4ff-8f0b-4da9-a2e8-34d03cb5856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:28.807535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a817a4ff-8f0b-4da9-a2e8-34d03cb5856e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:28.808744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a817a4ff-8f0b-4da9-a2e8-34d03cb5856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:28.817333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:28.852322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e342602-6f49-4f2d-a29f-08bcb2cc9fac None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:28.863746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e342602-6f49-4f2d-a29f-08bcb2cc9fac None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:28.867246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2daaea-63a6-4d13-a165-db533d0abca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:28.868225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2daaea-63a6-4d13-a165-db533d0abca5 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:28.868225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2daaea-63a6-4d13-a165-db533d0abca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:28.868494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2daaea-63a6-4d13-a165-db533d0abca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:28.877155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2daaea-63a6-4d13-a165-db533d0abca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:28.878556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2daaea-63a6-4d13-a165-db533d0abca5 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:28.888799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 760/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:32.441870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c9232-f9d4-4e61-a7a2-c53f5e7989c9 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:32.442303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c9232-f9d4-4e61-a7a2-c53f5e7989c9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:32.442475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c9232-f9d4-4e61-a7a2-c53f5e7989c9 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:32.443909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:54:32.449396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164795c-80ed-448b-b91a-c232de0c5ec5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:32.454153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164795c-80ed-448b-b91a-c232de0c5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:32.454153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164795c-80ed-448b-b91a-c232de0c5ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:32.456255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=62 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:32.468044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e164795c-80ed-448b-b91a-c232de0c5ec5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:32.469231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e164795c-80ed-448b-b91a-c232de0c5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:32.477976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:32.746050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c9232-f9d4-4e61-a7a2-c53f5e7989c9 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:32.747745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d27c9232-f9d4-4e61-a7a2-c53f5e7989c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:32.804541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c9232-f9d4-4e61-a7a2-c53f5e7989c9 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:32.808083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54a4e-4947-4de3-b90b-71d41f101a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:32.808715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54a4e-4947-4de3-b90b-71d41f101a50 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:32.809003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54a4e-4947-4de3-b90b-71d41f101a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:32.809287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54a4e-4947-4de3-b90b-71d41f101a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:32.818051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54a4e-4947-4de3-b90b-71d41f101a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:32.819504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54a4e-4947-4de3-b90b-71d41f101a50 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:32.828705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 775/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:34.971538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a222-baf5-494e-9187-b5d20cff58c3 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:34.972113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a222-baf5-494e-9187-b5d20cff58c3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:34.972113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a222-baf5-494e-9187-b5d20cff58c3 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:34.974011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 11:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:54:34.979090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907eab6-5cec-4b89-b75c-4829038a8d51 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:34.979525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907eab6-5cec-4b89-b75c-4829038a8d51 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:34.979658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907eab6-5cec-4b89-b75c-4829038a8d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:34.999186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c907eab6-5cec-4b89-b75c-4829038a8d51 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:54:35.000390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c907eab6-5cec-4b89-b75c-4829038a8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:35.008330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 11:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:54:35.267688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a222-baf5-494e-9187-b5d20cff58c3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:54:35.269353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e273a222-baf5-494e-9187-b5d20cff58c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:54:35.282631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a222-baf5-494e-9187-b5d20cff58c3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:54:35.286040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6d9d-b5e8-4731-b2d2-72d1661f569a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:54:35.286697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6d9d-b5e8-4731-b2d2-72d1661f569a service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:54:35.286977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6d9d-b5e8-4731-b2d2-72d1661f569a service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:54:35.287251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6d9d-b5e8-4731-b2d2-72d1661f569a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:54:35.295843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6d9d-b5e8-4731-b2d2-72d1661f569a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:54:35.297230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6d9d-b5e8-4731-b2d2-72d1661f569a service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:54:35.306366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 763/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:54:44.992391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=32 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:54:45.302269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=8 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:09.588653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.589652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.589652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.611939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:09.613167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:09.625992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 777/1540] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:09.637837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087a555-6c84-466e-9ec2-29a7ada00746 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.638739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087a555-6c84-466e-9ec2-29a7ada00746 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.638739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087a555-6c84-466e-9ec2-29a7ada00746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.679818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7087a555-6c84-466e-9ec2-29a7ada00746 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:09.681063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7087a555-6c84-466e-9ec2-29a7ada00746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:09.693271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 764/1541] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:09.698186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:09.708811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ebed3-19b9-4e9b-95c6-132eb4f398e9 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:09.721079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:09.721759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.722042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.722322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.723086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:09.723397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:09.725082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:09.741349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 778/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:09.745882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e27b-7c7c-44f1-b565-30b6e8514f12 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.746449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e27b-7c7c-44f1-b565-30b6e8514f12 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.746971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e27b-7c7c-44f1-b565-30b6e8514f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.752363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:09.765993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad043aa-22c5-4817-b76e-aa1b3f52c27a admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:09.774190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:09.774893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.775178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.775456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.775776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7c83e27b-7c7c-44f1-b565-30b6e8514f12 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:09.776155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:09.777178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:56:09.777178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:56:09.777178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:56:09.777859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7c83e27b-7c7c-44f1-b565-30b6e8514f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:09.778365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952ceb-53c6-41fb-adc4-3055d7daaf23 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:09.809977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 765/1543] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:09.811869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985415c-9b61-405f-977c-7e5c3206723b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.812409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985415c-9b61-405f-977c-7e5c3206723b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.812900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985415c-9b61-405f-977c-7e5c3206723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.852985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e985415c-9b61-405f-977c-7e5c3206723b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:09.860911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e985415c-9b61-405f-977c-7e5c3206723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:09.873487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 766/1544] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:09.874634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe747c4-22db-4f11-b6d7-a61a616d4238 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.874930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe747c4-22db-4f11-b6d7-a61a616d4238 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.875208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe747c4-22db-4f11-b6d7-a61a616d4238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.905644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 779/1545] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:56:09.908476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7fe747c4-22db-4f11-b6d7-a61a616d4238 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:09.910101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7fe747c4-22db-4f11-b6d7-a61a616d4238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:09.910394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.911009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.911529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:09.947942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:09.949523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:09.989315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 767/1546] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:09.991696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb880986-3176-4552-86d6-40ec9db53f1c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:09.992252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb880986-3176-4552-86d6-40ec9db53f1c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:09.992730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb880986-3176-4552-86d6-40ec9db53f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.012376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-eb880986-3176-4552-86d6-40ec9db53f1c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.014127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-eb880986-3176-4552-86d6-40ec9db53f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.023169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 768/1547] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.024795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f331f6-da9c-4bda-a4ce-39be8fa45f12 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.025061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 780/1548] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.025666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f331f6-da9c-4bda-a4ce-39be8fa45f12 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.026075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.026367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f331f6-da9c-4bda-a4ce-39be8fa45f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.045069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad105f81-f5af-43d0-8995-f6c754c25e80 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.048517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-13f331f6-da9c-4bda-a4ce-39be8fa45f12 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.051528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-13f331f6-da9c-4bda-a4ce-39be8fa45f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.051989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.052700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.052957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.053802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.054555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.060454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.060569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 769/1549] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.060569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362a0a3-6ad0-47c4-ab23-5a40df4d3310 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.060569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362a0a3-6ad0-47c4-ab23-5a40df4d3310 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.060569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362a0a3-6ad0-47c4-ab23-5a40df4d3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.078474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3362a0a3-6ad0-47c4-ab23-5a40df4d3310 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.086513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3362a0a3-6ad0-47c4-ab23-5a40df4d3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.087515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 770/1550] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.088685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69e8a-a1e6-4df6-af1e-05e1c5e02ba5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.088973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69e8a-a1e6-4df6-af1e-05e1c5e02ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.089255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69e8a-a1e6-4df6-af1e-05e1c5e02ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.107425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7ec69e8a-a1e6-4df6-af1e-05e1c5e02ba5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.108530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7ec69e8a-a1e6-4df6-af1e-05e1c5e02ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.117749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 771/1551] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.121143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd675565-1521-4762-8545-d314911480ef None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.121143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd675565-1521-4762-8545-d314911480ef None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.121143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd675565-1521-4762-8545-d314911480ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.137481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-cd675565-1521-4762-8545-d314911480ef None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.138687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cd675565-1521-4762-8545-d314911480ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.146483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 772/1552] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.149846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08258b6e-f0e4-4ab1-9225-46b97445f42a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.149846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08258b6e-f0e4-4ab1-9225-46b97445f42a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.149846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08258b6e-f0e4-4ab1-9225-46b97445f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.169914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-08258b6e-f0e4-4ab1-9225-46b97445f42a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.171088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 781/1553] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.171297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-08258b6e-f0e4-4ab1-9225-46b97445f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.172101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.183538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f70d9-aabd-405d-b38b-c951ea78f013 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.185207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 773/1554] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.186548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618177be-e85d-444c-8f37-8f427613c22f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.186882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618177be-e85d-444c-8f37-8f427613c22f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.187146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618177be-e85d-444c-8f37-8f427613c22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.190001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.190693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.190981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.191309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.192053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.192362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.195586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.207417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 782/1555] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.208680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.212297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-618177be-e85d-444c-8f37-8f427613c22f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.213523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-618177be-e85d-444c-8f37-8f427613c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.220514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589d38e-6896-4e5a-b10a-8353dc0c74bb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.222953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 774/1556] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.224250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.224545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.224832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.225549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.226277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.226565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.226937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.227598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.227914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.229503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3a78-36bf-4359-aa94-2adf9aa95d13 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.242520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 783/1557] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.242520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.249663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.249769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.249769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.249964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.253656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 775/1558] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.254501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.262759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.263948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.264065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c0b5b-0f77-4634-bb7c-b58d1d4a07a7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.268520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.269173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.269458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.269739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.270455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.270786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.271642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 784/1559] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.271812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:56:10.271812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:56:10.271812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:56:10.272428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.272933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.281805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d960d4-8cef-42a1-abad-ee42903060a4 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.292282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 776/1560] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.292282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.292564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.292564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.292564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.292564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.292941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.292941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.296961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567b50-335b-4df1-a232-ac26c3c9e320 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.300875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 785/1561] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:10.301661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.305251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.306466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.306466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.306466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.307420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.309075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.309205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b24c7-587a-4a08-bfb4-6b7ac74d9a19 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.314884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb5b0-f26d-4dda-9780-b33d5009f201 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.320280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.321049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.321439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.321827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.321945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 777/1562] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.323288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.323443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.323657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.323851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.325357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.348776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:10.350673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:10.360283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 778/1563] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:10.360968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.372928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f272-a757-4057-83a5-3826201de8e9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.377446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.378082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.378365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.378675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.379355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.381267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.414858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 786/1564] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.414858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.450222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:10.469358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 779/1565] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.473199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b9870-43c9-4512-858b-6e727ec2a212 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.473366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.505698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:10.529896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.530561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.530870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.531147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.531868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.532173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.533141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26586-d239-4e39-afea-9d7330e9a5df admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.533776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.539339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.540077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.541413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.541413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.541844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.542227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.543959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.546106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 787/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.546847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.556012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 780/1567] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.556903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.558720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652f45-2a69-4a7f-b9eb-100a59403b02 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.563832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.564490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.564771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.565048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.565767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.567727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.567982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7a9b-e18d-417f-97de-488f719e2efd admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.572688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.573409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.573915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.574254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.575086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.576731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.588122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 781/1568] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:10.588884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.598602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed27d-d802-424e-a22a-b9f619bbd748 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.603693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.604296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.604577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.604852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.605516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.607407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.641555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 788/1569] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.642320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.703103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1b43-905d-4a37-a7b6-7a459c35da49 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.708064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.708754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.709038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.709313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.710555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:10.710896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.711047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 782/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.712518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.715945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.733293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 789/1571] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:10.733293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.737115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980db0e-bac7-4b02-a68a-ffb78b846260 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.786487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:10.798022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fb21-883f-4a55-8d19-f7bcfd05f831 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.799414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.800158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.800518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.800874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.801631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.802870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.803582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.803683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.803868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.804146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.804827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.805858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:56:10.805858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:56:10.805858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:56:10.807132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.912605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 790/1572] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.913351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.922562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f68c92-bc57-44e0-bc29-e271d0fbb44e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.927135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.927755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.928036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.928307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.928971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.930867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:10.941278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 783/1573] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:10.942084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:10.952311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75e4e-2157-4792-8060-cffb29a0baa0 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:10.956933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:10.957561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:10.957847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:10.958122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:10.958821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:10.961434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.017495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 791/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.018373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.048068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 784/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:10 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.050107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.080798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920699b-c1b7-449d-9c87-295e66541691 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.112704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990a9ca-2205-48da-a066-b5a58a6c3870 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.117485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.118181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.118467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.118774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.119465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.121408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.129620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:11.145886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.146812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.147826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.148101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] PATH_INFO: `/v3/projects/9083748d7f4a43f1ac3b8c654030cf66/users/ae201231375e4648abb4b2205796f8b9/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.162390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9083748d7f4a43f1ac3b8c654030cf66, user_id=ae201231375e4648abb4b2205796f8b9, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.164747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:56:11.164747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:56:11.164747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:56:11.165943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.243518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 792/1576] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:11 2022] PUT /identity/v3/projects/9083748d7f4a43f1ac3b8c654030cf66/users/ae201231375e4648abb4b2205796f8b9/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:11.243518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.243841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 785/1577] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.243841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.254454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf444e-7e35-433c-ab5b-12ccecfd337c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.294109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:11.308422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6878ab-d9c6-4ba9-86b6-ba2b7c588562 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.310514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.311202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.311484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.311789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.312472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.313773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.314351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.314465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.314787 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.315090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.315809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.317698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.399523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 793/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.400448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.409879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad99919-7155-47b2-8a06-c709fb3de5a2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.417198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.417198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.417198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.417198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.417687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.418857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 786/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.419433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.419695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.430021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 794/1580] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.430843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.440378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f4aff-bc70-470f-8cc6-3e0401021bb1 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.482475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385028-4945-46e9-ad88-875d97825f8e admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.487465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.488254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.488540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.488810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.489529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.491349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.500155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.500818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.504021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.504021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.504218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 787/1581] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.504316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.504405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.504482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.513189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961536d9-6953-4bcb-ba67-b5082e285693 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.517819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ee56b-9671-4351-8977-4d69e8c45db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.518458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee56b-9671-4351-8977-4d69e8c45db5 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.518941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee56b-9671-4351-8977-4d69e8c45db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.523851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee56b-9671-4351-8977-4d69e8c45db5 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.523851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ee56b-9671-4351-8977-4d69e8c45db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.523851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ee56b-9671-4351-8977-4d69e8c45db5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.593831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 795/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.594981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.604277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 788/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.605459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0c415-3960-4f87-8ce5-3c5eb72da15b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.605572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.605872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.606182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.611108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.611767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.612053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.612335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.613069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.614703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.625683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 796/1584] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.626521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.636288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f933fff-b5bc-4544-942a-48749f8a759f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.636991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] MFA Rules not processed for user `ae201231375e4648abb4b2205796f8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:11.638291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:11.640955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.641591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.642120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.642120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.642865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.644529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.660227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 797/1585] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.661037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.676565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31b4a-89a0-4aa2-8b64-d92fdb641827 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.681756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.682400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.682714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.683000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.683681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.685592 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.689023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:11.709088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 789/1586] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:11.710113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.720404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4a7d7-8de7-4101-bf57-9c5dd6a9efaf None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.725713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.726945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.727176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.727513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.728228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.729809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.739487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 790/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.740422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.749905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58f9c5-d77d-4fc0-a1d5-c5a11ad80ea7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.754345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.754955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.755239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.758706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.758706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.758706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.767172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 791/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.768096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.776939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434da41-77d6-4a53-b6d6-2b675f3ab3bb admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.781385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.784209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.784209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.784209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.784209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.784742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.795024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 792/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.795977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.805795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d11c2-0d2e-49ee-9adc-a99706f180c7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.810624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 798/1590] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.810750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.811389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.811677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.811793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.811965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.812752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.814489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.821487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f163d-9f28-49a9-a0a5-4c4fd8be43cf admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.825775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 793/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.825991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.826641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.826770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.827010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.827193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.827904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.829471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.836123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020abfe-6ddb-4f98-ac3c-f08c1cace32b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.839880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 799/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.840616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.840738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.841323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.841626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.841868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.842574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.844411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.850845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130ef05-1d9e-4ea6-ab32-f588bdec9631 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.854688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 794/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:11.856976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.858835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.859503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.859790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.860098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.860756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.862758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.864680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060611d-42de-453d-a3fe-bf370d2590d2 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:11.870042 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:11.870930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:11.871211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:11.871506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] PATH_INFO: `/v3/projects/432f360611584a6e957fc92d4f5b63b6/users/345fdabfccdd40f592a4d33b06d1678c/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:11.885861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432f360611584a6e957fc92d4f5b63b6, user_id=345fdabfccdd40f592a4d33b06d1678c, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:11.888522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:11.942152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 800/1594] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:11 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:11.943344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.964344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 795/1595] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:11 2022] PUT /identity/v3/projects/432f360611584a6e957fc92d4f5b63b6/users/345fdabfccdd40f592a4d33b06d1678c/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:11.965359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:11.989874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:12.008981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0661b-da3f-4a4d-9472-c6738dca4aaf admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.038190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dfd7c-fdc3-4d2b-9611-8f88f171c437 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.043022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.043852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.044168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.044532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.045182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.046813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.057225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 796/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:12.059476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.067764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.068656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.072154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.072154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] PATH_INFO: `/v3/projects/9605590a14fd4c889535b000aa064a09/users/d3b2fff3179d40c58d41c1bb422454f6/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.072338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3de1-3762-4a89-8fe6-ce9d1aee66be admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.074706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.075349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.075636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.076186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.077046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.078714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.084656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9605590a14fd4c889535b000aa064a09, user_id=d3b2fff3179d40c58d41c1bb422454f6, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.087395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.088823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 797/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:12.089669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.100626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8ce2-1b6c-4953-8f6c-d9eda29c2e20 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.105261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.105891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.106179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.106460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.107203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.108770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.119440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 798/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:12.120843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.129181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f328-1781-431b-b57c-5ec3e6758688 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.135473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.138151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.138151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.138151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] PATH_INFO: `/v3/projects/ac92d33d0472472e8f02874fb93f21b7/users/3cf5430244c340f6988b3a9ebca9d777/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.142763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 801/1599] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:11 2022] PUT /identity/v3/projects/9605590a14fd4c889535b000aa064a09/users/d3b2fff3179d40c58d41c1bb422454f6/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:12.143361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.151596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac92d33d0472472e8f02874fb93f21b7, user_id=3cf5430244c340f6988b3a9ebca9d777, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.154256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.212914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cadb03-19be-474d-8eb1-de0fbb97e5fc admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.217713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438f306-e82d-46d3-8b3c-3b53831645cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.218664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438f306-e82d-46d3-8b3c-3b53831645cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.218952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438f306-e82d-46d3-8b3c-3b53831645cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.219781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438f306-e82d-46d3-8b3c-3b53831645cd admin admin] PATH_INFO: `/v3/projects/478c248cfa7d4f2eaf4e2cc3440bf8da/users/daeda01f27034ddcafe45bd8f7d15a24/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.238342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438f306-e82d-46d3-8b3c-3b53831645cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=478c248cfa7d4f2eaf4e2cc3440bf8da, user_id=daeda01f27034ddcafe45bd8f7d15a24, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.239822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 799/1600] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:12 2022] PUT /identity/v3/projects/ac92d33d0472472e8f02874fb93f21b7/users/3cf5430244c340f6988b3a9ebca9d777/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:12.240441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.245535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438f306-e82d-46d3-8b3c-3b53831645cd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.261056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:12.309282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5d4a-a184-4b8a-a243-52f6d8de5769 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.313935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.314612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.314905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.315185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.315866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.317869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.325420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 802/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:12 2022] PUT /identity/v3/projects/478c248cfa7d4f2eaf4e2cc3440bf8da/users/daeda01f27034ddcafe45bd8f7d15a24/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:12.326823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.327214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.327573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.353191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] MFA Rules not processed for user `345fdabfccdd40f592a4d33b06d1678c`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:12.358798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.396393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:12.416780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 803/1602] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:12.417648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.428040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 800/1603] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:12.428853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.439898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a94029-5f45-4b56-b36c-351a0717b742 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.487371 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac458-c8f3-460a-b643-ccd5d60bd15b None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.492035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda57cd8-d65a-4386-a0e2-7e2b1a57cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.492915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda57cd8-d65a-4386-a0e2-7e2b1a57cf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.493199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda57cd8-d65a-4386-a0e2-7e2b1a57cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.493482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda57cd8-d65a-4386-a0e2-7e2b1a57cf9e admin admin] PATH_INFO: `/v3/projects/e3cf25b3a33743ffba05876b495bd2c7/users/8612344a6d044a8d9e22f0d0fbef68e1/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.500916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.501594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.501880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.502162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.503545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.505192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.508532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda57cd8-d65a-4386-a0e2-7e2b1a57cf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf25b3a33743ffba05876b495bd2c7, user_id=8612344a6d044a8d9e22f0d0fbef68e1, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.511215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda57cd8-d65a-4386-a0e2-7e2b1a57cf9e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.515608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 801/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:12.516462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.526432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a81f3-407f-47ea-92ac-8da1cdbcff6a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.531087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaee25-1f83-4572-80df-910eb9c8eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.531931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaee25-1f83-4572-80df-910eb9c8eb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.532213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaee25-1f83-4572-80df-910eb9c8eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.532487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaee25-1f83-4572-80df-910eb9c8eb60 admin admin] PATH_INFO: `/v3/projects/e2c441eff5ca4c409fa4a6fb890c873c/users/74a385bb185540399cffa8895a7a3816/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.546905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaee25-1f83-4572-80df-910eb9c8eb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c441eff5ca4c409fa4a6fb890c873c, user_id=74a385bb185540399cffa8895a7a3816, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.549571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaee25-1f83-4572-80df-910eb9c8eb60 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.576685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 804/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:12 2022] PUT /identity/v3/projects/e3cf25b3a33743ffba05876b495bd2c7/users/8612344a6d044a8d9e22f0d0fbef68e1/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:12.578027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5ac0-180a-49f0-91dd-5366885c8943 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.578317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5ac0-180a-49f0-91dd-5366885c8943 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.578624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5ac0-180a-49f0-91dd-5366885c8943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.595518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2b7e5ac0-180a-49f0-91dd-5366885c8943 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:12.596741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2b7e5ac0-180a-49f0-91dd-5366885c8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.638612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 802/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:12 2022] PUT /identity/v3/projects/e2c441eff5ca4c409fa4a6fb890c873c/users/74a385bb185540399cffa8895a7a3816/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:12.639967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.640337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.640683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.654190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 805/1607] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:12.655620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5c45-dac3-4917-b2cd-84e362d76a96 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.656009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5c45-dac3-4917-b2cd-84e362d76a96 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.656495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5c45-dac3-4917-b2cd-84e362d76a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.662138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:12.664011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.675849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-bf6b5c45-dac3-4917-b2cd-84e362d76a96 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:12.677025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bf6b5c45-dac3-4917-b2cd-84e362d76a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.725135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 803/1608] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:12.725981 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.735062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac617d7-ecc0-4b1a-bf2f-82a4a60060e5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.737867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 806/1609] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:12.739265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244f20b-d64d-4a05-b21e-8db1071e3d71 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.739556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244f20b-d64d-4a05-b21e-8db1071e3d71 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.739833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244f20b-d64d-4a05-b21e-8db1071e3d71 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.742721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 807/1610] 10.222.0.36 () {54 vars in 961 bytes} [Thu Jun 16 11:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:12.743137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5ff5-79a8-4007-bcb6-ec6389e397cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.743490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244f20b-d64d-4a05-b21e-8db1071e3d71 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.743801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5ff5-79a8-4007-bcb6-ec6389e397cc admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.744113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5ff5-79a8-4007-bcb6-ec6389e397cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.744355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5ff5-79a8-4007-bcb6-ec6389e397cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.745081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec5ff5-79a8-4007-bcb6-ec6389e397cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.746695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec5ff5-79a8-4007-bcb6-ec6389e397cc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.757836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 804/1611] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:12.758219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244f20b-d64d-4a05-b21e-8db1071e3d71 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.759950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02efe8d-3fc0-41b8-934c-7026e83b1b70 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.760435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02efe8d-3fc0-41b8-934c-7026e83b1b70 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.760980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02efe8d-3fc0-41b8-934c-7026e83b1b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.762960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.763890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.764170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.764442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] PATH_INFO: `/v3/projects/be1138c14f3644be97b0763d598dc746/users/e42fceb39a344909872c5c1a091f207b/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.772913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:12.778779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e02efe8d-3fc0-41b8-934c-7026e83b1b70 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:12.779160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1138c14f3644be97b0763d598dc746, user_id=e42fceb39a344909872c5c1a091f207b, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.784991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e02efe8d-3fc0-41b8-934c-7026e83b1b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.785133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.787693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 805/1612] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:12.788967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.789251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.789523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.807251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:12.808475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.809851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:12.816179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 806/1613] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:12.816933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.818148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:12.868662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 808/1614] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:12 2022] PUT /identity/v3/projects/be1138c14f3644be97b0763d598dc746/users/e42fceb39a344909872c5c1a091f207b/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:12.869498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:12.877488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a86a29-0190-42fe-9f91-f544bf0b518e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.929105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88036-3ea3-4361-8b4f-3b0afc8d13f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.929750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88036-3ea3-4361-8b4f-3b0afc8d13f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.929913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2e3c-8525-4198-b49c-24d31f2f6873 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:12.930019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88036-3ea3-4361-8b4f-3b0afc8d13f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.930296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88036-3ea3-4361-8b4f-3b0afc8d13f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.933619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:12.934257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:12.934548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:12.934861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:12.993939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88036-3ea3-4361-8b4f-3b0afc8d13f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.995028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:12.995359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88036-3ea3-4361-8b4f-3b0afc8d13f4 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:12.996518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.005104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 807/1615] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.007105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.007395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.007707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.007923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 809/1616] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.008731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.016771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132ee27-8fe0-436a-b5bd-3645015fef3a service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.021046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.022409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.022970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.023264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.027630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:13.028893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:13.037180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.041327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.054206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 810/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.055061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.065050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03566-22e8-4358-816b-0f0b09ffb0c0 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.071240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b24e82-97f2-4b0f-a5d6-43fb3025b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.072296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24e82-97f2-4b0f-a5d6-43fb3025b3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.072579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24e82-97f2-4b0f-a5d6-43fb3025b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.072854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24e82-97f2-4b0f-a5d6-43fb3025b3eb admin admin] PATH_INFO: `/v3/projects/feea070bbefe41eba5720e66d56cb06e/users/c6db5898308b42b08b6275af5ed27a03/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.088455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b24e82-97f2-4b0f-a5d6-43fb3025b3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=feea070bbefe41eba5720e66d56cb06e, user_id=c6db5898308b42b08b6275af5ed27a03, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.092698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b24e82-97f2-4b0f-a5d6-43fb3025b3eb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.095107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:13.111460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 808/1618] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Jun 16 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:13.112274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.121222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c83d46-602c-4e7b-bfae-528af53eb760 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.125030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.125647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.125932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.126211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.135244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.136655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.146358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 809/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.147082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.154604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd587-1283-468b-816c-821c1d7161d7 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.158427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.158957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.159248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.159522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.176991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.178945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 811/1620] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:13 2022] PUT /identity/v3/projects/feea070bbefe41eba5720e66d56cb06e/users/c6db5898308b42b08b6275af5ed27a03/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:13.180345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.180466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.182873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.182873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.198351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 810/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.199298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.215740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] MFA Rules not processed for user `e42fceb39a344909872c5c1a091f207b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:13.218020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:13.218135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b32a6-21a4-4d2f-bd07-357d01b8da25 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.282887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:13.304901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 812/1622] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:13.305884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.312946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.313722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.314010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.314301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.411748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37bb43-dae6-4e00-a2cc-7def137a6333 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.423060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.424174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.424566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.425125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.426015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.427782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.434072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.438768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.440993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 813/1623] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:13.442469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.458724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 811/1624] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.461203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.480947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326793-7909-48a9-985a-14d71476c930 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.484480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44207f-1d5b-4498-9e91-7746df9ea847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.485365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44207f-1d5b-4498-9e91-7746df9ea847 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.485812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44207f-1d5b-4498-9e91-7746df9ea847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.486375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44207f-1d5b-4498-9e91-7746df9ea847 admin admin] PATH_INFO: `/v3/projects/feea070bbefe41eba5720e66d56cb06e/users/c6db5898308b42b08b6275af5ed27a03/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.489826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44207f-1d5b-4498-9e91-7746df9ea847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feea070bbefe41eba5720e66d56cb06e, user_id=c6db5898308b42b08b6275af5ed27a03, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.493100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44207f-1d5b-4498-9e91-7746df9ea847 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.510672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 812/1625] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:13 2022] PUT /identity/v3/projects/feea070bbefe41eba5720e66d56cb06e/users/c6db5898308b42b08b6275af5ed27a03/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:13.520202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.521160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.521160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.525267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272f899-c87e-4448-8d58-3b689a56350f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.554765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] MFA Rules not processed for user `c6db5898308b42b08b6275af5ed27a03`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:13.556044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:13.591049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8fb9-fff3-498e-bb5f-43c5b2373f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.591746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8fb9-fff3-498e-bb5f-43c5b2373f82 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.592027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8fb9-fff3-498e-bb5f-43c5b2373f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.592302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8fb9-fff3-498e-bb5f-43c5b2373f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.616467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:13.684397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 813/1626] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:13.693463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:13.699417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8fb9-fff3-498e-bb5f-43c5b2373f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.701605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8fb9-fff3-498e-bb5f-43c5b2373f82 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.715441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.719981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 814/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.743919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5cbcc-c8be-4b1a-b206-554ec46d2e11 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.752561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e23c85-3304-448b-90de-fd819d8a5d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.755211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e23c85-3304-448b-90de-fd819d8a5d33 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.755445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e23c85-3304-448b-90de-fd819d8a5d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.755632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e23c85-3304-448b-90de-fd819d8a5d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.772024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e23c85-3304-448b-90de-fd819d8a5d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.773887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e23c85-3304-448b-90de-fd819d8a5d33 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.785954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 814/1628] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.825378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa603df-bf6e-42cd-b96e-0407000148e2 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.825669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa603df-bf6e-42cd-b96e-0407000148e2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.825953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa603df-bf6e-42cd-b96e-0407000148e2 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.827694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 815/1629] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jun 16 11:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:13.834087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a85b75-9825-4ceb-adf2-6f2d9a6b9146 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.835092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a85b75-9825-4ceb-adf2-6f2d9a6b9146 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.835092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a85b75-9825-4ceb-adf2-6f2d9a6b9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.859078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-49a85b75-9825-4ceb-adf2-6f2d9a6b9146 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:13.862459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-49a85b75-9825-4ceb-adf2-6f2d9a6b9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:13.868400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa603df-bf6e-42cd-b96e-0407000148e2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:13.883283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa603df-bf6e-42cd-b96e-0407000148e2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:13.887765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:13.888711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:13.889071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:13.890055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:13.957446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:13.959048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:13.975494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 816/1630] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:13.997195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 815/1631] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:14.865136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:14.875074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea9c8-5ed3-4603-815d-9b7cf419e533 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:14.882932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44717be6-6975-4c5f-a6e9-2aab6240c0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:14.882932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717be6-6975-4c5f-a6e9-2aab6240c0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:14.882932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717be6-6975-4c5f-a6e9-2aab6240c0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:14.882932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717be6-6975-4c5f-a6e9-2aab6240c0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:14.892748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44717be6-6975-4c5f-a6e9-2aab6240c0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:14.894195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44717be6-6975-4c5f-a6e9-2aab6240c0a3 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:14.908604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 817/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:16.351420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715c67-14fb-4404-abf0-750fee19c049 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:16.351938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715c67-14fb-4404-abf0-750fee19c049 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:16.352999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715c67-14fb-4404-abf0-750fee19c049 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:16.353605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 816/1633] 10.222.0.36 () {54 vars in 961 bytes} [Thu Jun 16 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:16.372021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e7e4-f076-4a3f-9e1d-153abdbb7ce6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:16.372940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e7e4-f076-4a3f-9e1d-153abdbb7ce6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:16.373506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e7e4-f076-4a3f-9e1d-153abdbb7ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:16.408167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6504e7e4-f076-4a3f-9e1d-153abdbb7ce6 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:16.409829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6504e7e4-f076-4a3f-9e1d-153abdbb7ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:16.424329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 818/1634] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Jun 16 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:16.431659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d7e4-2a95-443b-93a2-f427f987c09a None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:16.432200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d7e4-2a95-443b-93a2-f427f987c09a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:16.432773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d7e4-2a95-443b-93a2-f427f987c09a None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:16.439299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 817/1635] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jun 16 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:16.440899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:16.443323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:16.444390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:16.487717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:16.490516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:16.522561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 819/1636] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:16.557308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d7e4-2a95-443b-93a2-f427f987c09a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:16.575371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d7e4-2a95-443b-93a2-f427f987c09a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:16.579951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f11c6-3ab1-494d-9648-573807d1d22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:16.581225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f11c6-3ab1-494d-9648-573807d1d22d service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:16.582886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f11c6-3ab1-494d-9648-573807d1d22d service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:16.583645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f11c6-3ab1-494d-9648-573807d1d22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:16.609569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f11c6-3ab1-494d-9648-573807d1d22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:16.611353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f11c6-3ab1-494d-9648-573807d1d22d service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:16.633110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 818/1637] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:19.466349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:19.620087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08836b11-ccf1-4667-9905-7cdd53d28b23 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:19.642737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:19.643786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:19.644069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:19.644361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] PATH_INFO: `/v3/users/345fdabfccdd40f592a4d33b06d1678c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:19.646247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345fdabfccdd40f592a4d33b06d1678c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:19.647702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: WARNING py.warnings [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:56:19.647702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: warnings.warn(msg) Jun 16 11:56:19.647702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: Jun 16 11:56:19.649278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:19.939452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345fdabfccdd40f592a4d33b06d1678c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:19.945243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345fdabfccdd40f592a4d33b06d1678c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:20.062289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345fdabfccdd40f592a4d33b06d1678c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:20.098628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345fdabfccdd40f592a4d33b06d1678c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:20.111840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:20.157612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345fdabfccdd40f592a4d33b06d1678c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:20.204335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 820/1638] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:19 2022] DELETE /identity/v3/users/345fdabfccdd40f592a4d33b06d1678c => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:20.208596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:20.209170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:20.209784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:20.243404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:20.245070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:20.372140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 819/1639] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:20.385515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:20.387614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:20.579081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:20.583768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:20.597189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3568-a6f6-4924-ad53-43ab151cc947 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:20.611591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecfbee-583d-45d6-ae8a-43cf4a39bf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:20.613256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecfbee-583d-45d6-ae8a-43cf4a39bf56 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:20.613700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecfbee-583d-45d6-ae8a-43cf4a39bf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:20.614201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecfbee-583d-45d6-ae8a-43cf4a39bf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:20.622970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4e8ce-4f2b-4f91-bbb9-bb1de8cbebd4 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:20.628978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:20.630031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:20.630386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:20.630776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] PATH_INFO: `/v3/users/ae201231375e4648abb4b2205796f8b9` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:20.632238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae201231375e4648abb4b2205796f8b9)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:20.634704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecfbee-583d-45d6-ae8a-43cf4a39bf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:20.636829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:20.644677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecfbee-583d-45d6-ae8a-43cf4a39bf56 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:20.666285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 821/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:20.907275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:20.931953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae201231375e4648abb4b2205796f8b9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:20.932998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae201231375e4648abb4b2205796f8b9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:20.951128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae201231375e4648abb4b2205796f8b9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:21.034095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae201231375e4648abb4b2205796f8b9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:21.060992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae201231375e4648abb4b2205796f8b9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:21.072387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 820/1641] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:20 2022] DELETE /identity/v3/users/ae201231375e4648abb4b2205796f8b9 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:21.075190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:21.075805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:21.076287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:21.133442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:21.137994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:21.300103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 822/1642] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:21.345753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:21.347822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:21.491555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fdb5-12c1-404f-bf24-395a016357ce admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:21.503481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189f49f-4e56-4fae-932c-f89733bd42e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:21.504164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189f49f-4e56-4fae-932c-f89733bd42e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:21.504738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189f49f-4e56-4fae-932c-f89733bd42e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:21.505023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189f49f-4e56-4fae-932c-f89733bd42e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:21.533190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189f49f-4e56-4fae-932c-f89733bd42e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:21.538886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189f49f-4e56-4fae-932c-f89733bd42e4 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:21.587915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 821/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:22.589864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:22.594962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:22.623530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a02d-6b55-4499-af70-fc3df2404817 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:22.638170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:22.639122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:22.639413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:22.639698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] PATH_INFO: `/v3/projects/432f360611584a6e957fc92d4f5b63b6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:22.643306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432f360611584a6e957fc92d4f5b63b6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:22.645302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:22.824025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432f360611584a6e957fc92d4f5b63b6', 'request_id': 'req-a2d0111b-7034-4585-a7ce-c2943c433c01'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:22.831831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432f360611584a6e957fc92d4f5b63b6', 'request_id': 'req-a2d0111b-7034-4585-a7ce-c2943c433c01'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:22.915800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432f360611584a6e957fc92d4f5b63b6', 'request_id': 'req-a2d0111b-7034-4585-a7ce-c2943c433c01'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:22.948347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] The token cache is being invalidate because project 432f360611584a6e957fc92d4f5b63b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:22.952945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:22.952945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a2d0111b-7034-4585-a7ce-c2943c433c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:22.956160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 823/1644] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:22 2022] DELETE /identity/v3/projects/432f360611584a6e957fc92d4f5b63b6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:22.957185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:22.957692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:22.957765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:22.992997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:22.994245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:23.144951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 822/1645] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:23.153315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.153776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.154120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.185146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:23.187006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:23.205932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 824/1646] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:23.206418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.220495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e797a-a423-4e3f-b8ab-ea7368d7d1f9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.233700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.234400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.234736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.235022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.235946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:23.236218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.242902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.273406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 823/1647] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:56:23.282714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.285515 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:23.290854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fd106-09a9-41c0-94b8-0be0d82808cc None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.300374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7cff-fc5a-48e4-9ddc-67512b951c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.301439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7cff-fc5a-48e4-9ddc-67512b951c8d admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.301935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7cff-fc5a-48e4-9ddc-67512b951c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.302450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7cff-fc5a-48e4-9ddc-67512b951c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.303499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7cff-fc5a-48e4-9ddc-67512b951c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.305651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7cff-fc5a-48e4-9ddc-67512b951c8d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.415378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 825/1648] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:23 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:23.419813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.435142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160edbd3-2efd-402e-8e4a-b2c9daca311e admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.460189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.461780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.462070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.505204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] MFA Rules not processed for user `daeda01f27034ddcafe45bd8f7d15a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:23.507661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:23.520219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:23.557486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.557486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.557486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.557486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.557979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.564640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.615461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 826/1649] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:23.632899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.636808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:23.698395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 824/1650] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:23 2022] POST /identity/v3/users => generated 303 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:23.702281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.724784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49f78-4a0f-4d99-b679-7781fc87b2e6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.736604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.737875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.738361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.739123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.740170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.749067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.773163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 825/1651] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:23.778806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.805934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122465-4cdf-4d5a-ba0d-610ad43cc58d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.817208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.817996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.818351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.819256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.820085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.821834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.830162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac844-074b-48b5-9a1a-29500f8310ba None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.846655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 826/1652] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:23.847426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.848118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.848407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.848748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.850053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.862427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.864114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.875352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610cb81-9ee4-4fdf-bad0-e226259ed4cf admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.884865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c556af-509c-4862-94b6-f0d8ea5418e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.885773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c556af-509c-4862-94b6-f0d8ea5418e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.886056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c556af-509c-4862-94b6-f0d8ea5418e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.886378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c556af-509c-4862-94b6-f0d8ea5418e9 admin admin] PATH_INFO: `/v3/projects/0b7ded4cf40c4c9fbf601f8ceb85a72c/users/d8c37c18ab18410a98f75e9ea3cccf19/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.892749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 827/1653] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:23.908017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:23.909510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:23.927118 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c556af-509c-4862-94b6-f0d8ea5418e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7ded4cf40c4c9fbf601f8ceb85a72c, user_id=d8c37c18ab18410a98f75e9ea3cccf19, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.930113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c556af-509c-4862-94b6-f0d8ea5418e9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:23.936639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf91d6-3ed1-4108-a26b-42cce6b34859 service nova] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:23.947582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:23.948487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:23.948778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:23.949149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] PATH_INFO: `/v3/projects/9083748d7f4a43f1ac3b8c654030cf66` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:23.951748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9083748d7f4a43f1ac3b8c654030cf66)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:23.953139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:24.029074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 827/1654] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:23 2022] PUT /identity/v3/projects/0b7ded4cf40c4c9fbf601f8ceb85a72c/users/d8c37c18ab18410a98f75e9ea3cccf19/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:24.035393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:24.036057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:24.036492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:24.075611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:24.077167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:24.139862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9083748d7f4a43f1ac3b8c654030cf66', 'request_id': 'req-97431862-029b-4569-96bd-b71edd2028d6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.153670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9083748d7f4a43f1ac3b8c654030cf66', 'request_id': 'req-97431862-029b-4569-96bd-b71edd2028d6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.215551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 828/1655] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:24.239106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9083748d7f4a43f1ac3b8c654030cf66', 'request_id': 'req-97431862-029b-4569-96bd-b71edd2028d6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.255953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] The token cache is being invalidate because project 9083748d7f4a43f1ac3b8c654030cf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:24.256467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.258673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.262288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 828/1656] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:23 2022] DELETE /identity/v3/projects/9083748d7f4a43f1ac3b8c654030cf66 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:56:24.267790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:24.274884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:24.276376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:24.281143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b7e0-24fb-4127-936e-83256419a965 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:24.403906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431862-029b-4569-96bd-b71edd2028d6 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:24.408007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:24.408675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:24.408964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:24.409248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:24.415618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:24.449374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:24.451430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:24.451724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:24.452152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] PATH_INFO: `/v3/users/c6db5898308b42b08b6275af5ed27a03` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:24.456103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6db5898308b42b08b6275af5ed27a03)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:24.460635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:24.544669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:24.546223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:24.571728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 829/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:56:24.679257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6db5898308b42b08b6275af5ed27a03'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.680071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6db5898308b42b08b6275af5ed27a03'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.694438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6db5898308b42b08b6275af5ed27a03'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.771007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6db5898308b42b08b6275af5ed27a03'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.794112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f3ab98a6-40f7-473a-8d73-73e33dc4b5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6db5898308b42b08b6275af5ed27a03'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:24.810364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 829/1658] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:24 2022] DELETE /identity/v3/users/c6db5898308b42b08b6275af5ed27a03 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:25.291000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:25.479555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:26.117375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:26.119712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:26.138099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c596df-253e-4531-95f8-4ab490f54866 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:26.276122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:26.277358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:26.277840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:26.278487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] PATH_INFO: `/v3/projects/feea070bbefe41eba5720e66d56cb06e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:26.281488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feea070bbefe41eba5720e66d56cb06e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:26.286024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:26.445439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feea070bbefe41eba5720e66d56cb06e', 'request_id': 'req-fb486099-2508-4209-8d74-d47360363c80'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:26.460964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feea070bbefe41eba5720e66d56cb06e', 'request_id': 'req-fb486099-2508-4209-8d74-d47360363c80'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:26.559723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feea070bbefe41eba5720e66d56cb06e', 'request_id': 'req-fb486099-2508-4209-8d74-d47360363c80'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:26.583419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] The token cache is being invalidate because project feea070bbefe41eba5720e66d56cb06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:26.584245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:26.586394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fb486099-2508-4209-8d74-d47360363c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:26.589450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 830/1659] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:26 2022] DELETE /identity/v3/projects/feea070bbefe41eba5720e66d56cb06e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:26.594698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:26.595166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:26.595372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:26.642222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:26.644727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:26.841274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 830/1660] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:26.848550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:26.848966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:26.849157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:26.898759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:26.900119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:26.917648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 831/1661] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:26.922421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:26.937985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7146-5682-470c-b8ce-e90e2ada7e4f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:26.954724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:26.955380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:26.955816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:26.956099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:26.956847 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:26.957260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:26.962625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:26.983093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:26.984637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:27.015552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 831/1662] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:27.016223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353553c-f120-4589-a229-e6bc0fa7586a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:27.019684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:27.041894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0ee5-1ceb-4139-8f90-8f1400b74a41 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:27.057479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:27.059270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.059731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:27.066063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.066063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.067253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.067253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.067476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:27.067476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:27.067656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] PATH_INFO: `/v3/users/e42fceb39a344909872c5c1a091f207b` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.071460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42fceb39a344909872c5c1a091f207b)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:27.077560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:27.241653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:27.256734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 832/1663] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:27 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:27.260746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:27.383542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42fceb39a344909872c5c1a091f207b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:27.385130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42fceb39a344909872c5c1a091f207b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:27.415237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d1ad-f863-4af0-87de-2fe750bbd1ee admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:27.432207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:27.432907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.433190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.433470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.434168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:27.436131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:27.503050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42fceb39a344909872c5c1a091f207b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:27.531369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42fceb39a344909872c5c1a091f207b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:27.542688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 833/1664] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:27 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:27.544552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:27.561442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e6861-d066-46c3-add0-d70a43b1fe79 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:27.579058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:27.580369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.580369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.581037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.583009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:27.587112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:27.587891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-31f3e36f-0ba7-4276-a839-970b4024887a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42fceb39a344909872c5c1a091f207b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:27.599988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 832/1665] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:26 2022] DELETE /identity/v3/users/e42fceb39a344909872c5c1a091f207b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:27.609921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 834/1666] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:56:27.615129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:27.615465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.616902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.617235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.618679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:27.649193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e021f0-6696-4b84-85fb-273364cc841b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:27.651552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:27.652666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:27.654192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:27.780691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 833/1667] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:27.806293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:27.807418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.809060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.809425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.812305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:27.814030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:27.821351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:27.824841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:27.841337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 835/1668] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:27.846044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:27.864326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456543f6-8f09-40e7-8d0e-e95342f68714 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:27.878185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3977a8-5407-4d7a-95c9-9cf194636f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:27.879131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3977a8-5407-4d7a-95c9-9cf194636f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:27.879421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3977a8-5407-4d7a-95c9-9cf194636f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:27.879699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3977a8-5407-4d7a-95c9-9cf194636f6c admin admin] PATH_INFO: `/v3/projects/3bfec7186c734d6eb9ca3174fe3e6db8/users/23bfd57166ce4798af29b053fcc04c84/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:27.912491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3977a8-5407-4d7a-95c9-9cf194636f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfec7186c734d6eb9ca3174fe3e6db8, user_id=23bfd57166ce4798af29b053fcc04c84, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:27.915266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3977a8-5407-4d7a-95c9-9cf194636f6c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:28.019765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069731-1c0e-428b-b438-5dc166f98d67 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:28.046996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:28.046996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:28.046996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:28.046996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:28.083093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:28.084317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 836/1669] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:27 2022] PUT /identity/v3/projects/3bfec7186c734d6eb9ca3174fe3e6db8/users/23bfd57166ce4798af29b053fcc04c84/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:56:28.095125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:28.095740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:28.096038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:28.096313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:28.121600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 834/1670] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:28.141987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] MFA Rules not processed for user `23bfd57166ce4798af29b053fcc04c84`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:28.144936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:28.285729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 837/1671] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:28.295516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:28.313690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217af3-8c29-4423-ba5a-8e1261cd1509 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:28.514846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:28.515537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:28.518009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:28.518319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:28.519104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:28.532173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:28.710567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 835/1672] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:28 2022] POST /identity/v3/projects => generated 383 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:28.715942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:28.730748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aa0c7-7728-4677-ace2-fc00dd27ee17 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:28.917747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:28.918510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:28.918818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:28.919039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:28.919764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:28.921734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:29.066716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 838/1673] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:28 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:29.071882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:29.086540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6f6c-2208-4e13-8002-66f6921a3017 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:29.102220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:29.107986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:29.107986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:29.107986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:29.107986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:29.107986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:29.142851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:29.157932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 836/1674] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:29.168546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3123e6-97a6-4a36-92d1-f38edac64e86 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:29.181225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:29.181225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:29.181225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:29.181225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] PATH_INFO: `/v3/projects/f501391b8b354fe3b3f4bb1da9119a56/users/04eca35386044ca29200a9b1df609cab/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:29.200791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f501391b8b354fe3b3f4bb1da9119a56, user_id=04eca35386044ca29200a9b1df609cab, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:29.206706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:29.297821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:29.298647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 839/1675] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:29 2022] PUT /identity/v3/projects/f501391b8b354fe3b3f4bb1da9119a56/users/04eca35386044ca29200a9b1df609cab/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:29.311196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6498dd-5051-4732-8af8-322753e963bd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:29.352957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:29.470107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65144b-fda6-4937-a720-f16344027d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:29.471355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65144b-fda6-4937-a720-f16344027d2e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:29.471759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65144b-fda6-4937-a720-f16344027d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:29.472890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65144b-fda6-4937-a720-f16344027d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:29.478030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65144b-fda6-4937-a720-f16344027d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:29.478030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65144b-fda6-4937-a720-f16344027d2e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:29.512445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:29.525509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 837/1676] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:29.528674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f648b69-2a7b-4cde-89ef-a45cba78d151 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:29.541554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:29.544688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:29.545505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:29.546038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] PATH_INFO: `/v3/projects/f501391b8b354fe3b3f4bb1da9119a56/users/04eca35386044ca29200a9b1df609cab/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:29.552211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f501391b8b354fe3b3f4bb1da9119a56, user_id=04eca35386044ca29200a9b1df609cab, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:29.558125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:29.599029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d743-9754-4537-83cd-e2a38eabb02e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:29.599445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d743-9754-4537-83cd-e2a38eabb02e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:29.599743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d743-9754-4537-83cd-e2a38eabb02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:29.601694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 840/1677] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:29 2022] PUT /identity/v3/projects/f501391b8b354fe3b3f4bb1da9119a56/users/04eca35386044ca29200a9b1df609cab/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:56:29.652226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ddd5d743-9754-4537-83cd-e2a38eabb02e None None] MFA Rules not processed for user `04eca35386044ca29200a9b1df609cab`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:29.653498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ddd5d743-9754-4537-83cd-e2a38eabb02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:29.826146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 838/1678] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:29.834094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:29.837081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:29.896698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:29.948374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:29.948532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:29.949266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:30.010362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964031f5-6a7f-4e95-80b9-4fa356008c93 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:30.028315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:30.030377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:30.030702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:30.031037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:30.039284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] MFA Rules not processed for user `d3b2fff3179d40c58d41c1bb422454f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:30.039813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:30.079589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:30.082132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:30.118036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 841/1679] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:30.210005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 839/1680] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:30.233136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:30.235294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:30.386155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:30.396229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a688d7d-940c-43ba-af38-0f3bd5cd6aff None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:30.408609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:30.410094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:30.416077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:30.416595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:30.441379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc20b11-5565-4cef-b806-fa24f9d7a2f5 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:30.456615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0b61-d063-475f-97bb-7380acc9995b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:30.457300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0b61-d063-475f-97bb-7380acc9995b service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:30.457589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0b61-d063-475f-97bb-7380acc9995b service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:30.457872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0b61-d063-475f-97bb-7380acc9995b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:30.480753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f0b61-d063-475f-97bb-7380acc9995b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:30.482393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f0b61-d063-475f-97bb-7380acc9995b service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:30.502345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 842/1681] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:56:30.548978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:30.550137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:30.569587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 840/1682] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:30.716807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:30.717121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:30.717403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:30.811310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] MFA Rules not processed for user `3cf5430244c340f6988b3a9ebca9d777`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:30.830375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.069311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 843/1683] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:31.083940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:31.086344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.117050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b68ed-9f6f-4df8-a85f-807bedd64623 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:31.129992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2028f-6753-4126-bf8e-866c244a8e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:31.130742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2028f-6753-4126-bf8e-866c244a8e67 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.131568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2028f-6753-4126-bf8e-866c244a8e67 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.131901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2028f-6753-4126-bf8e-866c244a8e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:31.142414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:31.145267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2028f-6753-4126-bf8e-866c244a8e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:31.147171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2028f-6753-4126-bf8e-866c244a8e67 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:31.163270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 841/1684] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:31.186067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:31.187524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.252651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:31.299482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f6df9-bf35-4bf4-8b20-2a9b338f04f5 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:31.321023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d72f3-a2ae-42e3-8448-15b7884a9524 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.321375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d72f3-a2ae-42e3-8448-15b7884a9524 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.322008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d72f3-a2ae-42e3-8448-15b7884a9524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:31.322129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:31.323106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.323554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.323983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] PATH_INFO: `/v3/projects/be1138c14f3644be97b0763d598dc746` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:31.325471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1138c14f3644be97b0763d598dc746)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:31.327396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: WARNING py.warnings [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 11:56:31.327396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: warnings.warn(msg) Jun 16 11:56:31.327396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: Jun 16 11:56:31.329345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:31.399725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e92d72f3-a2ae-42e3-8448-15b7884a9524 None None] MFA Rules not processed for user `8612344a6d044a8d9e22f0d0fbef68e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:31.400971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e92d72f3-a2ae-42e3-8448-15b7884a9524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.533233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 842/1685] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:31.534847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270e3b8-1d03-4bbb-bd7b-f24d69d2c395 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.535148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270e3b8-1d03-4bbb-bd7b-f24d69d2c395 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.535436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270e3b8-1d03-4bbb-bd7b-f24d69d2c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:31.594155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1138c14f3644be97b0763d598dc746', 'request_id': 'req-a76fc24f-c8fd-4c49-967c-33bf81a103d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:31.612105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1138c14f3644be97b0763d598dc746', 'request_id': 'req-a76fc24f-c8fd-4c49-967c-33bf81a103d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:31.612223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6270e3b8-1d03-4bbb-bd7b-f24d69d2c395 None None] MFA Rules not processed for user `d8c37c18ab18410a98f75e9ea3cccf19`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:31.613391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6270e3b8-1d03-4bbb-bd7b-f24d69d2c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.696221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1138c14f3644be97b0763d598dc746', 'request_id': 'req-a76fc24f-c8fd-4c49-967c-33bf81a103d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:31.728353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] The token cache is being invalidate because project be1138c14f3644be97b0763d598dc746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:31.729044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:31.731324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:31.734850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 844/1686] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:31 2022] DELETE /identity/v3/projects/be1138c14f3644be97b0763d598dc746 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:31.736824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:31.741355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.769922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 843/1687] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:31.771568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e6394-b7f3-4637-bd19-17bd5ffca9c2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.775777 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e6394-b7f3-4637-bd19-17bd5ffca9c2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.776238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e6394-b7f3-4637-bd19-17bd5ffca9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:31.829110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a16e6394-b7f3-4637-bd19-17bd5ffca9c2 None None] MFA Rules not processed for user `8612344a6d044a8d9e22f0d0fbef68e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:31.830428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a16e6394-b7f3-4637-bd19-17bd5ffca9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:31.913073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc24f-c8fd-4c49-967c-33bf81a103d7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:31.924859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:31.926194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.926680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.927109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] PATH_INFO: `/v3/users/23bfd57166ce4798af29b053fcc04c84` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:31.929451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23bfd57166ce4798af29b053fcc04c84)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:31.931617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:31.972476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 844/1688] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:31.975702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:31.981598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:31.981598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:32.027691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:32.029538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:32.054151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 845/1689] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:32.055928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:32.057392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:32.091398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913abaf-4bc3-4e99-9f2a-2e8acd117cff None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:32.097164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:32.099954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:32.100247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:32.100586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:32.101318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:32.103529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:32.282556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 846/1690] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:32 2022] POST /identity/v3/projects => generated 405 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:32.285529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:32.291631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:32.323633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23bfd57166ce4798af29b053fcc04c84'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:32.325851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23bfd57166ce4798af29b053fcc04c84'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:32.352943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23bfd57166ce4798af29b053fcc04c84'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:32.434775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23bfd57166ce4798af29b053fcc04c84'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:32.467373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1965ba6d-8dcf-469e-b0d7-1414849fbe91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23bfd57166ce4798af29b053fcc04c84'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:32.487581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 845/1691] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:31 2022] DELETE /identity/v3/users/23bfd57166ce4798af29b053fcc04c84 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:32.489399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:32.499127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:32.500059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:32.551257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa852fa-1739-47ce-a6ff-900d18b61a39 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:32.581020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:32.587733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:32.650662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:32.768523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:32.772268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 846/1692] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:32.773219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:32.773643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:32.774064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:32.774415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:32.776997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:32.781682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:32.814389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:32.831819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4504de-8225-4da7-a00c-7bac3c456f1c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:32.868142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a445d-d53e-4d6d-b486-bf4a353d08ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:32.869182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a445d-d53e-4d6d-b486-bf4a353d08ef admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:32.869629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a445d-d53e-4d6d-b486-bf4a353d08ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:32.870061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a445d-d53e-4d6d-b486-bf4a353d08ef admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:32.871030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a445d-d53e-4d6d-b486-bf4a353d08ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:32.876262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a445d-d53e-4d6d-b486-bf4a353d08ef admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:32.930687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:32.932207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ea77-d7f9-45b1-8bdf-bfef274bfb07 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:32.950372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 847/1693] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:32.952738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1f34-2c83-45fd-a198-17ffb73c959d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:32.954904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1f34-2c83-45fd-a198-17ffb73c959d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:32.959927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1f34-2c83-45fd-a198-17ffb73c959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:32.996222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-212c1f34-2c83-45fd-a198-17ffb73c959d None None] MFA Rules not processed for user `74a385bb185540399cffa8895a7a3816`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:32.997818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-212c1f34-2c83-45fd-a198-17ffb73c959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:33.005752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 847/1694] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:32 2022] POST /identity/v3/users => generated 309 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:33.007731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.009329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.009765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.047142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:33.048258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:33.076549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 848/1695] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:33.077415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.095716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e9ed4-09e2-4b5c-ac65-b0d0dd71b6f6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.126778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.127494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.127782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.128062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.128803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:33.129298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.132011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.146894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 848/1696] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:33.164300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370103-f80b-46d8-b3c8-f8c914674bc9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.165769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370103-f80b-46d8-b3c8-f8c914674bc9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.166046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370103-f80b-46d8-b3c8-f8c914674bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.171566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 849/1697] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:33.172626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.204439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03754ff8-e517-4b5d-9867-e27953665839 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.218361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.219304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.219992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.220410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.221286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.224184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-74370103-f80b-46d8-b3c8-f8c914674bc9 None None] MFA Rules not processed for user `daeda01f27034ddcafe45bd8f7d15a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:33.227833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-74370103-f80b-46d8-b3c8-f8c914674bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:33.230794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.255199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 850/1698] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:33.256906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.264111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:33.376229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 849/1699] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:33.376229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.376229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.376229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.395844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2b7a7-11d1-420c-bef8-70f32b0425ca admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.406379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.407079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.407364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.407640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.425118 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.428673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.428799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] MFA Rules not processed for user `74a385bb185540399cffa8895a7a3816`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:33.432170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:33.439956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 850/1700] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:33.442025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.451879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 851/1701] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:33.456115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.476893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24938-5279-4a4c-90a8-e098560e69a7 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.481568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f087-9107-43d3-9c99-2cc29d955cc2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.495242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.496145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.496638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.497051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.497339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.497956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.498565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.499011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.499429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] PATH_INFO: `/v3/projects/601218e261654ba48f7373a13fd6630d/users/1de6646871b14d6c9df2b8af034af301/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.500475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.540353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601218e261654ba48f7373a13fd6630d, user_id=1de6646871b14d6c9df2b8af034af301, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.543315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.549678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:33.644639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 852/1702] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:33 2022] PUT /identity/v3/projects/601218e261654ba48f7373a13fd6630d/users/1de6646871b14d6c9df2b8af034af301/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:33.652869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.674430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 851/1703] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:33 2022] POST /identity/v3/projects => generated 403 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:33.675571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.907404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db20091-29e0-490d-a391-a1e546dfda10 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.918523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557156c-7b06-4a6a-84f5-700ab6b81b44 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:33.922347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.923228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:33.924145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.925087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.925547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.927408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.931000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:33.931522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:33.931971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:33.932894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:33.940295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.940557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:33.963899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 853/1704] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:33.970270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:33.982828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cb24b-2fe7-4ad6-9e69-1229faaafdee admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:34.007764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:34.008965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.009344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.009757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] PATH_INFO: `/v3/projects/601218e261654ba48f7373a13fd6630d/users/1de6646871b14d6c9df2b8af034af301/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.012727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601218e261654ba48f7373a13fd6630d, user_id=1de6646871b14d6c9df2b8af034af301, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:34.015921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:34.047615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 852/1705] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:33 2022] POST /identity/v3/users => generated 302 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:34.051296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 854/1706] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:33 2022] PUT /identity/v3/projects/601218e261654ba48f7373a13fd6630d/users/1de6646871b14d6c9df2b8af034af301/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:34.054245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:34.075203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c1a8-f668-447f-9ef1-6784c4487170 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:34.173824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:34.175455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.176205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.176789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.178371 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:34.180476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:34.202111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:34.202631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 853/1707] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:34.218682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56fc24-f168-4b8d-833e-60664aa11002 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:34.229761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492ba0-6f76-4a7a-b0e4-43cbc0f16001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:34.230461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492ba0-6f76-4a7a-b0e4-43cbc0f16001 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.236172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492ba0-6f76-4a7a-b0e4-43cbc0f16001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.236522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492ba0-6f76-4a7a-b0e4-43cbc0f16001 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.237328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492ba0-6f76-4a7a-b0e4-43cbc0f16001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:34.238976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492ba0-6f76-4a7a-b0e4-43cbc0f16001 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:34.264502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 855/1708] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:34.270644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:34.293081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8595f-be56-4ca7-ba69-825a5ea26e3d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:34.314490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb71ec4-f490-474b-8df7-89e01f4408b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:34.318122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb71ec4-f490-474b-8df7-89e01f4408b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.325853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb71ec4-f490-474b-8df7-89e01f4408b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.326335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb71ec4-f490-474b-8df7-89e01f4408b7 admin admin] PATH_INFO: `/v3/projects/48ff05ad95a749949fca7b1ae5d04a86/users/5c2ecaa20a704bf490339e1ec4ec39bd/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.375483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb71ec4-f490-474b-8df7-89e01f4408b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ff05ad95a749949fca7b1ae5d04a86, user_id=5c2ecaa20a704bf490339e1ec4ec39bd, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:34.380239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb71ec4-f490-474b-8df7-89e01f4408b7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:34.471455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 854/1709] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:34 2022] PUT /identity/v3/projects/48ff05ad95a749949fca7b1ae5d04a86/users/5c2ecaa20a704bf490339e1ec4ec39bd/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:34.481970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440986e-e4c2-43f9-9e4d-8ba7556b9e81 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.482535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440986e-e4c2-43f9-9e4d-8ba7556b9e81 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.482535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440986e-e4c2-43f9-9e4d-8ba7556b9e81 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.484348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 856/1710] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jun 16 11:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:34.485473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.485773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.490128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.494817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91c8a8-4e8d-4f11-b331-b7def284194d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.495120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91c8a8-4e8d-4f11-b331-b7def284194d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.495397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91c8a8-4e8d-4f11-b331-b7def284194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.573002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] MFA Rules not processed for user `5c2ecaa20a704bf490339e1ec4ec39bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:34.574025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:34.599898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ea91c8a8-4e8d-4f11-b331-b7def284194d None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:34.604667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ea91c8a8-4e8d-4f11-b331-b7def284194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:34.632610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:34.738526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 855/1711] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:34.753153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:34.792476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 857/1712] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:34.794093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253e86-3eda-4b60-9f44-da901a337727 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.794390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253e86-3eda-4b60-9f44-da901a337727 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.794694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07253e86-3eda-4b60-9f44-da901a337727 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.798645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 858/1713] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jun 16 11:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:34.811751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07253e86-3eda-4b60-9f44-da901a337727 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:34.814753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-07253e86-3eda-4b60-9f44-da901a337727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:34.815059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:34.896796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958622-d627-4cb2-a8b5-6b283d552bb1 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:34.920727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba924d-7bd9-4d0f-8a33-19d37c9c5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:34.922733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba924d-7bd9-4d0f-8a33-19d37c9c5a8c admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.923030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba924d-7bd9-4d0f-8a33-19d37c9c5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.923316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba924d-7bd9-4d0f-8a33-19d37c9c5a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.926020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba924d-7bd9-4d0f-8a33-19d37c9c5a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:34.941736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba924d-7bd9-4d0f-8a33-19d37c9c5a8c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:34.977273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07253e86-3eda-4b60-9f44-da901a337727 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:34.991275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:34.992706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:34.993104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:34.993488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] PATH_INFO: `/v3/projects/3bfec7186c734d6eb9ca3174fe3e6db8` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:34.997907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfec7186c734d6eb9ca3174fe3e6db8)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.000157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.070635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 856/1714] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:34 2022] POST /identity/v3/projects => generated 405 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:35.072428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.072874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.073302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.104437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:35.108246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.188183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfec7186c734d6eb9ca3174fe3e6db8', 'request_id': 'req-febe193c-0743-4a48-93a1-382cc9bc6076'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.200709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfec7186c734d6eb9ca3174fe3e6db8', 'request_id': 'req-febe193c-0743-4a48-93a1-382cc9bc6076'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.204788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 857/1715] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:56:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:35.205589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.216082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.229653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389040-2f98-4641-9a6d-c9d43e2f6383 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.291595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfec7186c734d6eb9ca3174fe3e6db8', 'request_id': 'req-febe193c-0743-4a48-93a1-382cc9bc6076'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.325062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] The token cache is being invalidate because project 3bfec7186c734d6eb9ca3174fe3e6db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:35.325062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.326285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.329589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 859/1716] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:34 2022] DELETE /identity/v3/projects/3bfec7186c734d6eb9ca3174fe3e6db8 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:35.329783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.330455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.330771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.330888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.331050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.332704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.333501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.352978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.354361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.373865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 858/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:35.374849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.376409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.388151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d0a90-f3a0-465f-868a-d30d084b6f7a service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.393087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.393855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.394782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.395175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.397996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.413650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.417761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.434189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 859/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:35.437604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.441673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:35.448173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe193c-0743-4a48-93a1-382cc9bc6076 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.461982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.463282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.463282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.463447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.464013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.465963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.471282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573eaf0-0da5-485f-bb69-e74a58e0bf15 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.484322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.485214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.485498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.485774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] PATH_INFO: `/v3/users/04eca35386044ca29200a9b1df609cab` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.487624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04eca35386044ca29200a9b1df609cab)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.489665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.520811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:35.573635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 860/1719] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:35 2022] POST /identity/v3/users => generated 309 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:35.578326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.596508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cb12-3336-4251-89a8-6c40a62a4459 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.606549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.607266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.607551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.607832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.608660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.610313 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.632256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 861/1720] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:56:35.641723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.656346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f277-6a33-47fe-a157-058219a55f05 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.676476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.676476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.676476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.676476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] PATH_INFO: `/v3/projects/c0e7a145ab0b4cbeb53370cb6ad89544/users/a04126af0f0f4da6b078c9628a5f0f1a/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.698706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e7a145ab0b4cbeb53370cb6ad89544, user_id=a04126af0f0f4da6b078c9628a5f0f1a, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.701433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.780386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04eca35386044ca29200a9b1df609cab'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.781171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04eca35386044ca29200a9b1df609cab'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.804917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 862/1721] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:35 2022] PUT /identity/v3/projects/c0e7a145ab0b4cbeb53370cb6ad89544/users/a04126af0f0f4da6b078c9628a5f0f1a/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:35.809016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.879582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04eca35386044ca29200a9b1df609cab'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.889211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c017c5-93ee-406f-8508-7a3bab50eeca admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:35.896505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:35.897770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:35.898104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:35.898395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:35.899158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:35.899543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04eca35386044ca29200a9b1df609cab'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.901064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:35.915887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 863/1722] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:35.917467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:35.918731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9c2244cc-cc98-43f4-8d40-67806e25fc02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04eca35386044ca29200a9b1df609cab'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:35.932779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 860/1723] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:35 2022] DELETE /identity/v3/users/04eca35386044ca29200a9b1df609cab => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:35.948838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4124e-705b-40d9-9f1c-8b8931fc1f12 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:36.146243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:36.147280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.147629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.147935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] PATH_INFO: `/v3/projects/c0e7a145ab0b4cbeb53370cb6ad89544/users/a04126af0f0f4da6b078c9628a5f0f1a/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:36.151229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e7a145ab0b4cbeb53370cb6ad89544, user_id=a04126af0f0f4da6b078c9628a5f0f1a, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:36.155580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:36.185461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.185666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 864/1724] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:35 2022] PUT /identity/v3/projects/c0e7a145ab0b4cbeb53370cb6ad89544/users/a04126af0f0f4da6b078c9628a5f0f1a/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:36.185766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.186290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:36.233664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] MFA Rules not processed for user `a04126af0f0f4da6b078c9628a5f0f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:36.235188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:36.453564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:36.456106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:36.466579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 861/1725] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:36.482523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:36.484580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:36.621547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfe41-7141-4d8e-b0d1-4e16e7d43088 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:36.634646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:36.635243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.635535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.635812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:36.638189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:36.645278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427aea3-97db-4203-9b9c-6242e216771a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:36.650706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fbf70-852d-47d8-a5ac-59717611a6a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:36.652694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fbf70-852d-47d8-a5ac-59717611a6a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.653421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fbf70-852d-47d8-a5ac-59717611a6a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.653863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fbf70-852d-47d8-a5ac-59717611a6a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:36.697880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fbf70-852d-47d8-a5ac-59717611a6a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:36.699396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fbf70-852d-47d8-a5ac-59717611a6a4 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:36.733065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 862/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:36.738688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901fac5-fda2-4c5c-88bf-33b463164d06 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.738998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901fac5-fda2-4c5c-88bf-33b463164d06 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.739461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901fac5-fda2-4c5c-88bf-33b463164d06 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:36.747099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 863/1727] 10.222.0.36 () {54 vars in 960 bytes} [Thu Jun 16 11:56:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:36.748873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded36ae-0011-4d3f-a8fc-939a01db87a5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.749805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded36ae-0011-4d3f-a8fc-939a01db87a5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.750241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded36ae-0011-4d3f-a8fc-939a01db87a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:36.791042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5ded36ae-0011-4d3f-a8fc-939a01db87a5 None None] MFA Rules not processed for user `8612344a6d044a8d9e22f0d0fbef68e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:36.792389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5ded36ae-0011-4d3f-a8fc-939a01db87a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:36.810147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:36.812832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:36.832746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 865/1728] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:36.834195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:36.849152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:36.933331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:36.960154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:36.962213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 864/1729] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:36.963608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:36.967400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:36.967400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.029406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:37.032851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:37.070248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 865/1730] 10.222.0.36 () {58 vars in 1057 bytes} [Thu Jun 16 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:37.071383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:37.081076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:37.125454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb4ed-72fb-4bb0-bee9-623ca9dc4d50 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:37.173768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:37.179803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:37.180113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:37.180534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.193497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:37.236095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:37.238372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:37.289539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 866/1731] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:37.290953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3a7f-82ef-4aa3-9c17-9e02b912d119 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:37.303592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:37.315119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:37.316038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:37.319431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:37.319748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] PATH_INFO: `/v3/users/5c2ecaa20a704bf490339e1ec4ec39bd` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.326267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2ecaa20a704bf490339e1ec4ec39bd)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:37.329616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:37.341234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06c3d-f8cf-44ec-afa0-eb2a6d48e53c service placement] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:37.361025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2402a-b2c2-43c0-be0e-f36a86a61d2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:37.362795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2402a-b2c2-43c0-be0e-f36a86a61d2e service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:37.363085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2402a-b2c2-43c0-be0e-f36a86a61d2e service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:37.363369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2402a-b2c2-43c0-be0e-f36a86a61d2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.395791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2402a-b2c2-43c0-be0e-f36a86a61d2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:37.404041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2402a-b2c2-43c0-be0e-f36a86a61d2e service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:37.430008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 867/1732] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:37.440501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:37.440792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:37.441070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.511104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] MFA Rules not processed for user `3cf5430244c340f6988b3a9ebca9d777`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:37.512426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:37.715085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2ecaa20a704bf490339e1ec4ec39bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:37.716612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2ecaa20a704bf490339e1ec4ec39bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:37.799844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2ecaa20a704bf490339e1ec4ec39bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:37.823205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2ecaa20a704bf490339e1ec4ec39bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:37.823613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 868/1733] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:37.826603 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:37.830050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:37.861190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a224ccd7-f0df-4129-8816-29c8b726ecb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2ecaa20a704bf490339e1ec4ec39bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:37.863658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924426f-6709-43b3-9234-ece0b821a440 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:37.884441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:37.888867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 866/1734] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:37 2022] DELETE /identity/v3/users/5c2ecaa20a704bf490339e1ec4ec39bd => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:37.890773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cde2d-09e2-4805-9839-e67936c15b90 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:37.891308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cde2d-09e2-4805-9839-e67936c15b90 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:37.892368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cde2d-09e2-4805-9839-e67936c15b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.892803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:37.893994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:37.894925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] PATH_INFO: `/v3/projects/f501391b8b354fe3b3f4bb1da9119a56` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:37.899023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f501391b8b354fe3b3f4bb1da9119a56)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:37.904644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:38.072911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:38.151926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f501391b8b354fe3b3f4bb1da9119a56', 'request_id': 'req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:38.190365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f501391b8b354fe3b3f4bb1da9119a56', 'request_id': 'req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:38.304395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f501391b8b354fe3b3f4bb1da9119a56', 'request_id': 'req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:38.335609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] The token cache is being invalidate because project f501391b8b354fe3b3f4bb1da9119a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:38.336113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:38.341525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d2f552f3-c11b-4bde-b7ad-5cd70dd16302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:38.347370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 869/1735] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:37 2022] DELETE /identity/v3/projects/f501391b8b354fe3b3f4bb1da9119a56 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:38.349041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1b9c-6ff3-4b37-9901-14f2405f3f99 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:38.351487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1b9c-6ff3-4b37-9901-14f2405f3f99 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:38.359882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1b9c-6ff3-4b37-9901-14f2405f3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:38.469579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-946c1b9c-6ff3-4b37-9901-14f2405f3f99 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:38.471143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-946c1b9c-6ff3-4b37-9901-14f2405f3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:38.490009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:38.503831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-fe9cde2d-09e2-4805-9839-e67936c15b90 None None] MFA Rules not processed for user `1de6646871b14d6c9df2b8af034af301`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:38.505146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fe9cde2d-09e2-4805-9839-e67936c15b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:38.552040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 870/1736] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:38.554320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:38.554696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:38.554988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:38.576390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:38.581979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:38.589741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 871/1737] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:38.590928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:38.592612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:38.728861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 867/1738] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 839 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:38.748466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:38.749162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:38.749597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:38.809044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:38.811807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:38.817284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd195c-5cc0-4e8b-bdca-c4f9ffae463e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:38.834720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8964a-34ef-47a6-b4fc-cec1ab99e8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:38.835398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8964a-34ef-47a6-b4fc-cec1ab99e8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:38.835688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8964a-34ef-47a6-b4fc-cec1ab99e8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:38.835966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8964a-34ef-47a6-b4fc-cec1ab99e8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:38.847692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 868/1739] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:38.853293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:38.878045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0344d-cc07-4da2-9415-e50e748cd612 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:38.879681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8964a-34ef-47a6-b4fc-cec1ab99e8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:38.881192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8964a-34ef-47a6-b4fc-cec1ab99e8d6 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:38.900293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:38.901206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:38.901494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:38.901775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:38.902532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:38.913508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:38.918230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:38.920458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 872/1740] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:38.944914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:38.945289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:38.945580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:38.963101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 869/1741] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:38.973217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:38.998352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] MFA Rules not processed for user `d3b2fff3179d40c58d41c1bb422454f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:38.999625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:39.005872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d82ca-f894-491a-8298-d3a69fdd64ef admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:39.022322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:39.023038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:39.023850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:39.023850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:39.031401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:39.032714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:39.175192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 873/1742] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:39.207322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 870/1743] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:38 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:39.212606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:39.229836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540637e-246d-4879-afa1-6ad28db2560f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:39.400410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:39.401131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:39.401422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:39.401700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:39.402406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:39.404461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:39.530633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:39.537512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 874/1744] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:39 2022] POST /identity/v3/users => generated 289 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:39.547631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efbb79-f112-4e73-9c82-696ba6d5197f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:39.564636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:39.567653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:39.568089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:39.569060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:39.572101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:39.583993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:39.598366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 871/1745] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:56:39.602468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:39.619663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b467c-06a9-476d-a195-3afd8480bfbe admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:39.636007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce528221-5bc5-479f-8d5b-49dc62da499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:39.636007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528221-5bc5-479f-8d5b-49dc62da499e admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:39.636007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528221-5bc5-479f-8d5b-49dc62da499e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:39.636007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528221-5bc5-479f-8d5b-49dc62da499e admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:39.636379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce528221-5bc5-479f-8d5b-49dc62da499e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:39.637650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce528221-5bc5-479f-8d5b-49dc62da499e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:39.658914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 875/1746] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:39.661718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:39.674773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7fd43-fd38-4e16-875b-799de28a4f5d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:39.694128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:39.695082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:39.697539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:39.697847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] PATH_INFO: `/v3/projects/3311b1dbf3e8487fabfde53b6c1e6987/users/a55e2d52e6f54d73ae9a3c17afe59287/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:39.718056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3311b1dbf3e8487fabfde53b6c1e6987, user_id=a55e2d52e6f54d73ae9a3c17afe59287, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:39.721191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:39.823599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 872/1747] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:39 2022] PUT /identity/v3/projects/3311b1dbf3e8487fabfde53b6c1e6987/users/a55e2d52e6f54d73ae9a3c17afe59287/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:39.834053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:39.836504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:39.836504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:39.903324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] MFA Rules not processed for user `a55e2d52e6f54d73ae9a3c17afe59287`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:39.905844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:40.174841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 876/1748] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:40.186907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:40.189014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:40.261985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:40.263812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:40.387520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4739a7-dd8b-49e7-8d96-4321a7119f59 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:40.388576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a414a-b0da-45ee-b2d3-5735a0e09962 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:40.394435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:40.395697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:40.396165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:40.396664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] PATH_INFO: `/v3/projects/48ff05ad95a749949fca7b1ae5d04a86` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:40.397334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:40.397992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:40.398279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:40.398560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:40.399289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ff05ad95a749949fca7b1ae5d04a86)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:40.403292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:40.414919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:40.421455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:40.441039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 873/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:40.457261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:40.593165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ff05ad95a749949fca7b1ae5d04a86', 'request_id': 'req-acf9480e-bc0e-4714-9cb7-ac377f659bad'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:40.606343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ff05ad95a749949fca7b1ae5d04a86', 'request_id': 'req-acf9480e-bc0e-4714-9cb7-ac377f659bad'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:40.687764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ff05ad95a749949fca7b1ae5d04a86', 'request_id': 'req-acf9480e-bc0e-4714-9cb7-ac377f659bad'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:40.714247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] The token cache is being invalidate because project 48ff05ad95a749949fca7b1ae5d04a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:40.714834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:40.716168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-acf9480e-bc0e-4714-9cb7-ac377f659bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:40.719516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 877/1750] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:40 2022] DELETE /identity/v3/projects/48ff05ad95a749949fca7b1ae5d04a86 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:40.723964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:40.745747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:40.772910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13278-6b17-4783-aff1-8d3b049ebe1f service glance] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:40.985743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:40.989013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:40.989309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:40.989652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] PATH_INFO: `/v3/users/a04126af0f0f4da6b078c9628a5f0f1a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:40.996708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04126af0f0f4da6b078c9628a5f0f1a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:40.999335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:41.031956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578898d-30c2-43be-a3e1-214c7a1c4e5b None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:41.032543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578898d-30c2-43be-a3e1-214c7a1c4e5b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:41.032686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578898d-30c2-43be-a3e1-214c7a1c4e5b None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:41.034368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 878/1751] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:41.050246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:41.051660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:41.052105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:41.109412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:41.111722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:41.292311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 879/1752] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:56:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:41.327356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:41.329006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:41.353875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6443ed-ac17-44e7-9f77-d6ded29d6f71 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:41.360352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04126af0f0f4da6b078c9628a5f0f1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:41.365057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04126af0f0f4da6b078c9628a5f0f1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:41.372231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074cf1-1b62-4aae-a713-985ea318c92d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:41.373498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074cf1-1b62-4aae-a713-985ea318c92d service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:41.373795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074cf1-1b62-4aae-a713-985ea318c92d service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:41.374068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074cf1-1b62-4aae-a713-985ea318c92d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:41.412909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d074cf1-1b62-4aae-a713-985ea318c92d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:41.415658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d074cf1-1b62-4aae-a713-985ea318c92d service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:41.450724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04126af0f0f4da6b078c9628a5f0f1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:41.452407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 880/1753] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:41.474786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04126af0f0f4da6b078c9628a5f0f1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:41.498706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83ae9f11-cacd-43b4-b028-e9f320d52890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04126af0f0f4da6b078c9628a5f0f1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:41.519499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 874/1754] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:40 2022] DELETE /identity/v3/users/a04126af0f0f4da6b078c9628a5f0f1a => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:41.760715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:42.199564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:42.827817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:42.828759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:42.829192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:42.889526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:42.891936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:43.059944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 881/1755] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:43.262847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:43.263811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:43.264236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:43.293164 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:43.294745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:43.325465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 875/1756] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:56:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:43.424581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:43.462107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:43.464016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:43.646407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:43.648198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:43.733351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a3df-8ab3-414b-9171-87b48f88f670 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:43.763161 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67240978-7541-4761-a136-a8635d817d60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:43.767497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67240978-7541-4761-a136-a8635d817d60 service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:43.767839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67240978-7541-4761-a136-a8635d817d60 service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:43.769595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67240978-7541-4761-a136-a8635d817d60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:43.790561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67240978-7541-4761-a136-a8635d817d60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:43.794190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67240978-7541-4761-a136-a8635d817d60 service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:43.867882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 882/1757] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:56:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:56:43.976732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e2fe-181d-408b-9b4a-6be9d8966990 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:44.003616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0aef75-9283-409f-bf91-db64cd52a0a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:44.004408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aef75-9283-409f-bf91-db64cd52a0a9 service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:44.004784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aef75-9283-409f-bf91-db64cd52a0a9 service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:44.010211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aef75-9283-409f-bf91-db64cd52a0a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:44.068147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0aef75-9283-409f-bf91-db64cd52a0a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:44.074987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0aef75-9283-409f-bf91-db64cd52a0a9 service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:44.128273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 876/1758] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:56:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:56:44.152268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc184b-33b1-4a1a-b77f-5117551cce8e None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:44.154475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc184b-33b1-4a1a-b77f-5117551cce8e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:44.155048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc184b-33b1-4a1a-b77f-5117551cce8e None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:44.157340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 883/1759] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:56:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:44.220117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:44.220519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:44.220871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:44.281335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] MFA Rules not processed for user `17efad13e88b4d58be51b897827532f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:44.283398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:44.311259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc184b-33b1-4a1a-b77f-5117551cce8e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:44.313835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-72fc184b-33b1-4a1a-b77f-5117551cce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:44.438280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:44.549729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc184b-33b1-4a1a-b77f-5117551cce8e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:44.561944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:44.564450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:44.565045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:44.566750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] PATH_INFO: `/v3/users/d8c37c18ab18410a98f75e9ea3cccf19` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:44.570168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c37c18ab18410a98f75e9ea3cccf19)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:44.574153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:44.578353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 877/1760] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:56:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:44.755361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:44.757738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:44.810943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9ecd2-2cb9-4a71-a462-d1ec37d4c7e3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:44.846043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:44.847402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:44.851780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:44.852378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:44.915983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c37c18ab18410a98f75e9ea3cccf19'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:44.917469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:44.917939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c37c18ab18410a98f75e9ea3cccf19'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:44.926382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:44.927490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c37c18ab18410a98f75e9ea3cccf19'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:45.002636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 878/1761] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:45.015861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c37c18ab18410a98f75e9ea3cccf19'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:45.036567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c37c18ab18410a98f75e9ea3cccf19'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:45.051403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 884/1762] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:44 2022] DELETE /identity/v3/users/d8c37c18ab18410a98f75e9ea3cccf19 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:56:45.713793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:45.828117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:45.830334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:45.881115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bbcc1-8f24-4daf-aa43-67758ac4bd23 service placement] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:46.259816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:46.259816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:46.259816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:46.259816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] PATH_INFO: `/v3/projects/c0e7a145ab0b4cbeb53370cb6ad89544` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:46.261756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e7a145ab0b4cbeb53370cb6ad89544)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:46.261756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:46.429569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:46.431159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:46.474767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e7a145ab0b4cbeb53370cb6ad89544', 'request_id': 'req-1baa944d-2843-49d8-9831-8977ce4e2993'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:46.503305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d2f2f-00ba-4c6f-a829-300758bfee98 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:46.507260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e7a145ab0b4cbeb53370cb6ad89544', 'request_id': 'req-1baa944d-2843-49d8-9831-8977ce4e2993'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:46.771235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:46.772593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:46.772881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:46.775065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] PATH_INFO: `/v3/projects/0b7ded4cf40c4c9fbf601f8ceb85a72c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:46.777000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7ded4cf40c4c9fbf601f8ceb85a72c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:46.784918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e7a145ab0b4cbeb53370cb6ad89544', 'request_id': 'req-1baa944d-2843-49d8-9831-8977ce4e2993'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:46.792671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:46.832737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] The token cache is being invalidate because project c0e7a145ab0b4cbeb53370cb6ad89544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:46.833840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:46.835473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1baa944d-2843-49d8-9831-8977ce4e2993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:46.838019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 879/1763] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:45 2022] DELETE /identity/v3/projects/c0e7a145ab0b4cbeb53370cb6ad89544 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:46.843535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160236-4ab7-417f-ace0-0bedcb5607d0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:46.844130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160236-4ab7-417f-ace0-0bedcb5607d0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:46.845231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160236-4ab7-417f-ace0-0bedcb5607d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:46.849712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:46.913017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-64160236-4ab7-417f-ace0-0bedcb5607d0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:46.917496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-64160236-4ab7-417f-ace0-0bedcb5607d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:46.956701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 880/1764] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:46.972831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:46.975891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:46.976432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.056409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:47.057996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:47.107425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7ded4cf40c4c9fbf601f8ceb85a72c', 'request_id': 'req-7280dcb7-78c1-440c-806e-d9d47da4c210'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.131529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7ded4cf40c4c9fbf601f8ceb85a72c', 'request_id': 'req-7280dcb7-78c1-440c-806e-d9d47da4c210'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.267929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7ded4cf40c4c9fbf601f8ceb85a72c', 'request_id': 'req-7280dcb7-78c1-440c-806e-d9d47da4c210'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.290555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] The token cache is being invalidate because project 0b7ded4cf40c4c9fbf601f8ceb85a72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:47.290882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.291840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.298400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 885/1765] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:46 2022] DELETE /identity/v3/projects/0b7ded4cf40c4c9fbf601f8ceb85a72c => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:47.299494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.304017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:47.313511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:47.369816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 881/1766] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:47.370852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.385476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680f3e-0e6d-4c6e-a456-5dd04dbacfe8 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:47.390566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:47.391292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:47.391591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:47.391862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.392759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:47.393072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:47.395612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:47.415894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 882/1767] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:56:47.417611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.433396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09552-bab2-40c5-bf20-8c03f0866b82 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:47.439193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:47.440115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:47.440965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:47.440965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.441468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:47.444069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:47.495635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280dcb7-78c1-440c-806e-d9d47da4c210 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:47.504734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:47.506638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:47.507269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:47.507846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] PATH_INFO: `/v3/users/1de6646871b14d6c9df2b8af034af301` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.509410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de6646871b14d6c9df2b8af034af301)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:47.512449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:47.552313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 883/1768] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:47 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:47.554097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.644974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67bbe-9a12-446a-a20b-0250ddb7e8c9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:47.650888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:47.651858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:47.652289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:47.652709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.653562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:47.661764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:47.789432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de6646871b14d6c9df2b8af034af301'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.795832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 884/1769] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:47 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:47.796011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de6646871b14d6c9df2b8af034af301'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.797426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.811747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3ca46-838d-43f3-a8fe-2296534a56da admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:47.817501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:47.818677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:47.819105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:47.819908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.821231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:47.823771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:47.855466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de6646871b14d6c9df2b8af034af301'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.883639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 885/1770] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:47.888176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.901347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bb3db-8907-4a89-b575-e5dc5c585d2f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:47.908668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:47.909857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:47.910376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:47.911016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:47.917990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:47.920963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:47.942785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 886/1771] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:47.950981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:47.965446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de6646871b14d6c9df2b8af034af301'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:47.980890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10985100-c8d1-4dde-a09d-ff9fdd63be6c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:48.007119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:48.009531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:48.010331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:48.010860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] PATH_INFO: `/v3/projects/c31415de7ed3439da21061b34086b4cb/users/abdd22fae3fc4202b1718aa8406dc221/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:48.027829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e093b1c-9ad3-49cf-8dfb-db1a565a985b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de6646871b14d6c9df2b8af034af301'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:48.032742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31415de7ed3439da21061b34086b4cb, user_id=abdd22fae3fc4202b1718aa8406dc221, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:48.036189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:48.045289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:48.067110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 886/1772] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:56:47 2022] DELETE /identity/v3/users/1de6646871b14d6c9df2b8af034af301 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:48.142393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 887/1773] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:47 2022] PUT /identity/v3/projects/c31415de7ed3439da21061b34086b4cb/users/abdd22fae3fc4202b1718aa8406dc221/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:48.143734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb9ac-6999-4cb3-a155-9ac1fa4cd735 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:48.144041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb9ac-6999-4cb3-a155-9ac1fa4cd735 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:48.144385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb9ac-6999-4cb3-a155-9ac1fa4cd735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:48.242901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-86deb9ac-6999-4cb3-a155-9ac1fa4cd735 None None] MFA Rules not processed for user `abdd22fae3fc4202b1718aa8406dc221`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:48.246922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-86deb9ac-6999-4cb3-a155-9ac1fa4cd735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:48.484391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 887/1774] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:48.489218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:48.491874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:48.699608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ae778-3af1-4344-9295-815eb8122e0a admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:48.706022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:48.707218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:48.707871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:48.708424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:48.712583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:48.729395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:48.870032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:48.874087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 888/1775] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:48 2022] POST /identity/v3/projects => generated 369 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:48.874891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:48.879025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:48.879636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:48.944087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:49.022576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155b01-ebc9-4729-a061-35bd0b2e35fb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.028012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.028857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.029248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.029610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.030532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.031120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:49.035286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.047119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:49.193852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 889/1776] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:48 2022] POST /identity/v3/users => generated 291 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:49.195387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:49.221037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eb54d-a699-4c9d-890c-a1a39d7ede62 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.238444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.239540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.239958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.241008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.241867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.243775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.277837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 890/1777] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:49.280014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:49.301526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352d269-6cdc-493e-b83d-f5fab7500a70 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.311557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.312708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.314960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.315404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] PATH_INFO: `/v3/projects/f5bec14298594b76b3d6d6de848ab661/users/721a4d8035e84dabac2d350afcdf93e7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.321303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 888/1778] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 16 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:49.364416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bec14298594b76b3d6d6de848ab661, user_id=721a4d8035e84dabac2d350afcdf93e7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.371783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.477311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 891/1779] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:49 2022] PUT /identity/v3/projects/f5bec14298594b76b3d6d6de848ab661/users/721a4d8035e84dabac2d350afcdf93e7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:49.481490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:49.485330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:49.487806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:49.528657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89642-c81c-470d-9886-10e6ce6ed239 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.529275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:49.621031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198dab-232b-4393-a374-4c75d33508de admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.628131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.629063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.629568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.630132 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.654632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.657418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.679769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 892/1780] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:56:49.680698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:49.683990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:49.710284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da159-095b-4154-a487-be5b31dc41ed service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.728957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.729631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.729920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.730197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.733420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e4ead-ce50-4b93-8e4c-361870cff09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.742746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4ead-ce50-4b93-8e4c-361870cff09a admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.742746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4ead-ce50-4b93-8e4c-361870cff09a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.742746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4ead-ce50-4b93-8e4c-361870cff09a admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.742746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4ead-ce50-4b93-8e4c-361870cff09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.742746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4ead-ce50-4b93-8e4c-361870cff09a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.744802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.746450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.766180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 893/1781] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:49.780715 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 889/1782] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:56:49.784240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:49.810171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eafecf-c85a-4055-ac4b-d529ff3c913e service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:49.838642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:49.844795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.844795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.844795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] PATH_INFO: `/v3/projects/f5bec14298594b76b3d6d6de848ab661/users/721a4d8035e84dabac2d350afcdf93e7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.844795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bec14298594b76b3d6d6de848ab661, user_id=721a4d8035e84dabac2d350afcdf93e7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:49.845456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:49.873686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 894/1783] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:49 2022] PUT /identity/v3/projects/f5bec14298594b76b3d6d6de848ab661/users/721a4d8035e84dabac2d350afcdf93e7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:49.884935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:49.885475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:49.885475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:49.891088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:49.958128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] MFA Rules not processed for user `721a4d8035e84dabac2d350afcdf93e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:49.961527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:50.204310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 890/1784] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:50.218179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:50.220753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:50.385263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25955e61-aec9-44bd-b3f2-254dd187a6f2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:50.389380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:50.390106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:50.390410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:50.390737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:50.402238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:50.404852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:50.417110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 895/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:50.691531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:50.707125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:50.708702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:50.761628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:50.770554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142acce-9991-4684-94b0-33133da97246 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:50.782052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93459-1148-4822-a181-0dfde323e2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:50.783795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93459-1148-4822-a181-0dfde323e2eb service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:50.783795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93459-1148-4822-a181-0dfde323e2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:50.783795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93459-1148-4822-a181-0dfde323e2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:50.900903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046de39-e4d2-4589-beca-0f601dd9d504 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:50.916763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:50.918726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:50.931861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:50.933367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] PATH_INFO: `/v3/projects/601218e261654ba48f7373a13fd6630d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:50.940750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] RBAC: Authorizing `identity:delete_project(project_id=601218e261654ba48f7373a13fd6630d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:50.942942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:50.943104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea93459-1148-4822-a181-0dfde323e2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:50.945278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea93459-1148-4822-a181-0dfde323e2eb service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:50.970523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 896/1786] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:56:51.187681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601218e261654ba48f7373a13fd6630d', 'request_id': 'req-62f3bdf2-74f3-4363-9c38-d1199c0484be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:51.214604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601218e261654ba48f7373a13fd6630d', 'request_id': 'req-62f3bdf2-74f3-4363-9c38-d1199c0484be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:51.285770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601218e261654ba48f7373a13fd6630d', 'request_id': 'req-62f3bdf2-74f3-4363-9c38-d1199c0484be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:51.317181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] The token cache is being invalidate because project 601218e261654ba48f7373a13fd6630d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:56:51.317625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:51.319809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62f3bdf2-74f3-4363-9c38-d1199c0484be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:56:51.325564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 891/1787] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:56:50 2022] DELETE /identity/v3/projects/601218e261654ba48f7373a13fd6630d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:51.334685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:51.334685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:51.334685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:51.438841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:51.445358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:51.514420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:51.616541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 897/1788] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:51.625651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:51.625960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:51.626278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:51.672207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:51.673759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:51.685028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 892/1789] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:51.689903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:51.702998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f367e-8372-49e0-8c69-0452e386489a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:51.708155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:51.709962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:51.710082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:51.710883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:51.712115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:56:51.712708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:51.715331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:51.736762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 898/1790] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:56:51.737827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:51.787774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d504417-eba6-4fdf-9f09-7417784cd60a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:51.809475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:51.810419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:51.811472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:51.812333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:51.814001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:51.820920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:51.948148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 893/1791] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:51 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:56:51.952765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:51.962855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958c473-393a-419e-baa1-7cfb824f232f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:52.042927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:52.043673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:52.043960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:52.044239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:52.044980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:52.047183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:52.145363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 899/1792] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:51 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:56:52.150372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:52.166551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49be0e-2c79-4633-b07a-1dc78b5a874a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:52.182443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:52.183266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:52.183609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:52.183894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:52.184682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:52.186307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:52.203846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 894/1793] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:52.208089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:52.224762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878ed51-e465-4b68-a100-da8056087c90 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:52.238301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fd84e-e0f1-4bef-92de-d1f91a11d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:52.239184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fd84e-e0f1-4bef-92de-d1f91a11d31d admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:52.239483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fd84e-e0f1-4bef-92de-d1f91a11d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:52.239995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fd84e-e0f1-4bef-92de-d1f91a11d31d admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:52.244564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fd84e-e0f1-4bef-92de-d1f91a11d31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:52.248106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fd84e-e0f1-4bef-92de-d1f91a11d31d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:52.304299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 900/1794] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:52.305657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:52.313739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:52.344065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93756-2da3-49c3-8628-d8ab5675da6b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:52.374296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:52.381699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:52.381699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:52.381699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] PATH_INFO: `/v3/projects/7033001a6bec474da4d0fc3413d992e9/users/9d9f47d6d8494358a2c138c6008e26a6/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:52.461230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7033001a6bec474da4d0fc3413d992e9, user_id=9d9f47d6d8494358a2c138c6008e26a6, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:52.468581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:52.571249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 895/1795] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:52 2022] PUT /identity/v3/projects/7033001a6bec474da4d0fc3413d992e9/users/9d9f47d6d8494358a2c138c6008e26a6/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:52.581990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:52.583110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:52.583635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:52.668425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] MFA Rules not processed for user `9d9f47d6d8494358a2c138c6008e26a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:52.670906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:52.789149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 901/1796] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:52.793593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:52.985791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482dc0-2a66-4c84-8b98-3a61b538cfff admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:52.985791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:52.985791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:52.985791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:52.986935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:52.986935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:52.986935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:53.108129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 896/1797] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:56:52 2022] POST /identity/v3/projects => generated 363 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:56:53.112580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:53.137682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d717-9891-4622-865c-5a7eec6ce8db None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:53.197537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:53.265717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:53.266579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:53.269417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:53.269417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:53.269417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:53.270177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:53.397663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 902/1798] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:56:53 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:56:53.400074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:53.435550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa507d0-2d2a-47dd-a463-14e0a24e159c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:53.444748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:53.447599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:53.447599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:53.447599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:53.448397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:53.463676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:53.510927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 897/1799] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:53.516569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:53.539268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da77e-2d57-4b3c-a72e-32749973e4bb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:53.563551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:53.563551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:53.565315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:53.565727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] PATH_INFO: `/v3/projects/07be7c53251a4b6489d1c9d4b2839d88/users/18845df3fcd44f40b8419cccdb214f2f/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:53.637859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07be7c53251a4b6489d1c9d4b2839d88, user_id=18845df3fcd44f40b8419cccdb214f2f, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:53.645311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:53.733821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 903/1800] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:53 2022] PUT /identity/v3/projects/07be7c53251a4b6489d1c9d4b2839d88/users/18845df3fcd44f40b8419cccdb214f2f/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:53.737685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:53.755247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f155a-07d5-4ddc-9ccd-b6943b90c6be admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:53.911656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dec12-96a1-4027-8b6b-c2e0909bbc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:53.913248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dec12-96a1-4027-8b6b-c2e0909bbc06 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:53.913807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dec12-96a1-4027-8b6b-c2e0909bbc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:53.914286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dec12-96a1-4027-8b6b-c2e0909bbc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:53.917476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dec12-96a1-4027-8b6b-c2e0909bbc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:53.918052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dec12-96a1-4027-8b6b-c2e0909bbc06 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:53.935486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 898/1801] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:56:53.939713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:53.952880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed3d1-031f-4676-94d0-36773602a426 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:53.974273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:53.977710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:53.978347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:53.980288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] PATH_INFO: `/v3/projects/07be7c53251a4b6489d1c9d4b2839d88/users/18845df3fcd44f40b8419cccdb214f2f/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:53.984862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07be7c53251a4b6489d1c9d4b2839d88, user_id=18845df3fcd44f40b8419cccdb214f2f, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:53.994406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:54.033156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 904/1802] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:56:53 2022] PUT /identity/v3/projects/07be7c53251a4b6489d1c9d4b2839d88/users/18845df3fcd44f40b8419cccdb214f2f/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:56:54.059108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c82686-e405-463a-a38c-1e8815ddbe40 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:54.059672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c82686-e405-463a-a38c-1e8815ddbe40 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:54.059887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c82686-e405-463a-a38c-1e8815ddbe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:54.153487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-16c82686-e405-463a-a38c-1e8815ddbe40 None None] MFA Rules not processed for user `18845df3fcd44f40b8419cccdb214f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:54.156535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-16c82686-e405-463a-a38c-1e8815ddbe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:54.245865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:56:54.300112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 899/1803] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:54.315980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:54.318119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:54.458028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba939a1-58ec-4be6-9600-ecf070a025f0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:54.479702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce824921-922c-4370-a3a9-4976352b7637 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:54.480576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce824921-922c-4370-a3a9-4976352b7637 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:54.480576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce824921-922c-4370-a3a9-4976352b7637 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:54.481644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 900/1804] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:56:54.486512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:54.490084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:54.490370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:54.490744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:54.518239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:54.519744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:54.571631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 905/1805] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:54.678455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ad30-5dc1-4d0b-87cb-72612660f601 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:54.678773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ad30-5dc1-4d0b-87cb-72612660f601 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:54.679068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ad30-5dc1-4d0b-87cb-72612660f601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:54.755531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-0116ad30-5dc1-4d0b-87cb-72612660f601 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:54.761524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0116ad30-5dc1-4d0b-87cb-72612660f601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:54.855645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:54.877797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15329f67-38b1-4cf9-b5b7-b451061eaabd service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:54.888242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:54.890681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:54.890974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:54.891258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:55.018269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 901/1806] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:56:55.050492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233eac-3865-40c1-94b8-929103a25f75 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:55.055601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233eac-3865-40c1-94b8-929103a25f75 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:55.055601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233eac-3865-40c1-94b8-929103a25f75 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:55.056768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 902/1807] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:56:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:56:55.091760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:55.092397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:55.092397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:55.132175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:55.133793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:55.170057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:56:55.173066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:55.200036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 906/1808] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:55.213853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 903/1809] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:56:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:56:55.999437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:56.001102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:56.076544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78d316-2328-434e-a210-93a0f090dfe1 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:56.085580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:56.086566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:56.087083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:56.089113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:56.098823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:56.101486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:56.116432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 907/1810] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:56:56.275229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:56:56.281096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:56:56.306965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c16e6-b6bd-4feb-8899-088aaf4dea28 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:56:56.331391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d13ac-6267-431b-a388-ee2d5c33424e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:56:56.332208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d13ac-6267-431b-a388-ee2d5c33424e service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:56:56.333143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d13ac-6267-431b-a388-ee2d5c33424e service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:56:56.333540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d13ac-6267-431b-a388-ee2d5c33424e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:56:56.349325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d13ac-6267-431b-a388-ee2d5c33424e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:56:56.351209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d13ac-6267-431b-a388-ee2d5c33424e service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:56:56.375489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 904/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:56:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:06.110038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:06.362720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=52 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:06.485077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:06.593131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd70d6-a59b-4dc1-bb93-cbe0ec00553a service nova] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:06.599264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:06.600759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:06.601111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:06.601455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] PATH_INFO: `/v3/users/9d9f47d6d8494358a2c138c6008e26a6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:06.602747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9f47d6d8494358a2c138c6008e26a6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:06.604752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:06.859894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9f47d6d8494358a2c138c6008e26a6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:06.860795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9f47d6d8494358a2c138c6008e26a6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:06.953105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9f47d6d8494358a2c138c6008e26a6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:06.962852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9f47d6d8494358a2c138c6008e26a6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:06.977201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9f47d6d8494358a2c138c6008e26a6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:06.986620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 908/1812] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:06 2022] DELETE /identity/v3/users/9d9f47d6d8494358a2c138c6008e26a6 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:06.989697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039895-261c-46a2-a563-9fc4f2ef76f8 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:06.989991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039895-261c-46a2-a563-9fc4f2ef76f8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:06.990326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039895-261c-46a2-a563-9fc4f2ef76f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:07.018798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b9039895-261c-46a2-a563-9fc4f2ef76f8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:07.025464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b9039895-261c-46a2-a563-9fc4f2ef76f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:07.099793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 905/1813] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:07.110110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:07.113287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:07.180906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27920-1efe-451d-a283-fa8f504807ef admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:07.185934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:07.186096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7926404-f5ad-4762-bb84-478ff0cde837 None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:07.186406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7926404-f5ad-4762-bb84-478ff0cde837 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:07.186647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7926404-f5ad-4762-bb84-478ff0cde837 None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:07.187024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:07.187305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:07.187604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:07.189066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 906/1814] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:57:07.198104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:07.199558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:07.210895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 909/1815] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:07.219948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:07.219948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:07.220174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:07.249994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:07.252748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:07.359240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 907/1816] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:07.378063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:07.380873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:07.396961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2327bf-baef-41ad-ba9d-6bf08f24dcdd service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:07.404251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:07.405146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:07.405599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:07.410555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:07.433105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:07.435971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:07.465465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 910/1817] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:07.789575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:07.792565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:07.810319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef3411-2347-4f08-beda-7d95c8c5ed01 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:07.815764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:07.817205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:07.817789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:07.818327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] PATH_INFO: `/v3/projects/7033001a6bec474da4d0fc3413d992e9` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:07.824793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7033001a6bec474da4d0fc3413d992e9)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:07.824793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:07.983941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7033001a6bec474da4d0fc3413d992e9', 'request_id': 'req-5a08362b-c976-4428-9198-d06160088a6b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:07.995525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7033001a6bec474da4d0fc3413d992e9', 'request_id': 'req-5a08362b-c976-4428-9198-d06160088a6b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.086405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7033001a6bec474da4d0fc3413d992e9', 'request_id': 'req-5a08362b-c976-4428-9198-d06160088a6b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.098319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] The token cache is being invalidate because project 7033001a6bec474da4d0fc3413d992e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:08.098742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.099484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.101310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 908/1818] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:07 2022] DELETE /identity/v3/projects/7033001a6bec474da4d0fc3413d992e9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:08.105159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:08.116048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8328c-678c-4609-b994-ceafbf477f6a service nova] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:08.128253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:08.233056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:08.234124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:08.234406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:08.234742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] PATH_INFO: `/v3/users/18845df3fcd44f40b8419cccdb214f2f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:08.237152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18845df3fcd44f40b8419cccdb214f2f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:08.238038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:08.458184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18845df3fcd44f40b8419cccdb214f2f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.459510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18845df3fcd44f40b8419cccdb214f2f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.524307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18845df3fcd44f40b8419cccdb214f2f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.535658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18845df3fcd44f40b8419cccdb214f2f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.551205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ea0bb099-9dc4-4eae-9b18-f8b6ee7444c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18845df3fcd44f40b8419cccdb214f2f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:08.559845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 911/1819] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:08 2022] DELETE /identity/v3/users/18845df3fcd44f40b8419cccdb214f2f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:09.134723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:09.136350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:09.151763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08362b-c976-4428-9198-d06160088a6b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:09.167389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:09.219980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:09.221114 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:09.221398 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:09.221673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] PATH_INFO: `/v3/projects/07be7c53251a4b6489d1c9d4b2839d88` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:09.223031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07be7c53251a4b6489d1c9d4b2839d88)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:09.225595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:09.354881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07be7c53251a4b6489d1c9d4b2839d88', 'request_id': 'req-74cea1d6-b8ba-4365-95cd-182261a07a81'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:09.361095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07be7c53251a4b6489d1c9d4b2839d88', 'request_id': 'req-74cea1d6-b8ba-4365-95cd-182261a07a81'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:09.451257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07be7c53251a4b6489d1c9d4b2839d88', 'request_id': 'req-74cea1d6-b8ba-4365-95cd-182261a07a81'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:09.468017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] The token cache is being invalidate because project 07be7c53251a4b6489d1c9d4b2839d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:09.468359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:09.469270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-74cea1d6-b8ba-4365-95cd-182261a07a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:09.474211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 909/1820] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:09 2022] DELETE /identity/v3/projects/07be7c53251a4b6489d1c9d4b2839d88 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:09.476450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:09.476930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:09.477149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:09.501761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:09.503157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:09.586709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 912/1821] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:09.598976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:09.599414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:09.600304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:09.619645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:09.620877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:09.628743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 910/1822] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:09.633024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:09.642978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452f9b-175c-46a6-9e32-140c292ecd48 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:09.647617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:09.648280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:09.648561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:09.648841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:09.649578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:09.649886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:09.651579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:09.664057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 913/1823] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:09.668352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:09.677578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd2837-d3b1-4b39-939a-2a6b6c3aeea1 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:09.683758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:09.684634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:09.684980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:09.685319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:09.686117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:09.688068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:09.816755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 911/1824] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:09 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:09.821662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:09.831979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4e5a-0673-4f30-bfb3-1547a8b4915c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:09.844183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:09.904356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:09.904356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:09.904356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:09.904356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:09.904725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:09.905681 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.024032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 914/1825] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:09 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:10.028550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.039937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a569f3-369c-425d-a377-994c0fef3b5f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.044924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.048511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.048511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.048511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.048511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.048511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.065180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 912/1826] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:10.069959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.080130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a01aba-818c-4ab6-9ccc-99995677607d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.085447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3865c9d-51c4-4d17-ba57-4ee5230eb488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.086110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865c9d-51c4-4d17-ba57-4ee5230eb488 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.086394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865c9d-51c4-4d17-ba57-4ee5230eb488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.086704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3865c9d-51c4-4d17-ba57-4ee5230eb488 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.087579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3865c9d-51c4-4d17-ba57-4ee5230eb488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.089179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3865c9d-51c4-4d17-ba57-4ee5230eb488 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.105252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 915/1827] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:10.105561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.114931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1e33-afaf-4756-b209-3b4801d74396 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.119702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.120582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.120867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.121144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] PATH_INFO: `/v3/projects/b9ca49393e4f45ae9c26ae907a2c7cbe/users/82e45cb69d5e4a54be2628807345dddf/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.137103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ca49393e4f45ae9c26ae907a2c7cbe, user_id=82e45cb69d5e4a54be2628807345dddf, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.139761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.239774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 913/1828] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:10 2022] PUT /identity/v3/projects/b9ca49393e4f45ae9c26ae907a2c7cbe/users/82e45cb69d5e4a54be2628807345dddf/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:10.250651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.250947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.251224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.280741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] MFA Rules not processed for user `82e45cb69d5e4a54be2628807345dddf`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:10.282007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:10.356870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 916/1829] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:10.361421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.408083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:10.427667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0512f-6998-44ad-a0ff-0da0e19244b2 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.433142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.433818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.434087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.434361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.435090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.437064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.560372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 914/1830] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:10 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:10.560865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.590508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce4da-1a07-4d3e-a33f-76b2e4a9b851 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.667031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.667712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.668000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.668281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.668986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.670932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.753113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 917/1831] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:10 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:10.757684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.768473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb45da-6f2f-41f2-a54e-5c08b122dac9 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.773823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.774482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.774801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.775072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.775794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.777444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.789591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 915/1832] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:10.793664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.805120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12deedb-9f7a-4549-beb9-a6c36eea1e18 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:10.810743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:10.811630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:10.811947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:10.812178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] PATH_INFO: `/v3/projects/bb5e9c68173c4d528a3dc170f7e2e126/users/8d490495f51e4dd38cf5f161d790f9b7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:10.826977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:10.829726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5e9c68173c4d528a3dc170f7e2e126, user_id=8d490495f51e4dd38cf5f161d790f9b7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:10.832538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:10.936925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 918/1833] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:10 2022] PUT /identity/v3/projects/bb5e9c68173c4d528a3dc170f7e2e126/users/8d490495f51e4dd38cf5f161d790f9b7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:10.941705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:10.950832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83919c-badd-4ebe-82b6-309373199dc8 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:11.139015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f921e-8ad7-46df-ae05-5a56dba89888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:11.139780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f921e-8ad7-46df-ae05-5a56dba89888 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:11.140096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f921e-8ad7-46df-ae05-5a56dba89888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:11.140475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f921e-8ad7-46df-ae05-5a56dba89888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:11.141204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f921e-8ad7-46df-ae05-5a56dba89888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:11.143191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f921e-8ad7-46df-ae05-5a56dba89888 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:11.160051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 916/1834] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:11.160890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:11.173308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb14d-85ea-481d-aa24-242a2626a0fa admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:11.178554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:11.179739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:11.180121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:11.180396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] PATH_INFO: `/v3/projects/bb5e9c68173c4d528a3dc170f7e2e126/users/8d490495f51e4dd38cf5f161d790f9b7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:11.182413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5e9c68173c4d528a3dc170f7e2e126, user_id=8d490495f51e4dd38cf5f161d790f9b7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:11.185094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:11.197311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 919/1835] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:11 2022] PUT /identity/v3/projects/bb5e9c68173c4d528a3dc170f7e2e126/users/8d490495f51e4dd38cf5f161d790f9b7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:11.208707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:11.209556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:11.209852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:11.244568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] MFA Rules not processed for user `8d490495f51e4dd38cf5f161d790f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:11.246144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:11.354073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 917/1836] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:11.367043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:11.369684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:11.488072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9fb62-0f69-4e13-885d-650cb55351ac admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:11.493484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:11.494169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:11.495079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:11.495079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:11.575203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:11.576669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:11.612511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 920/1837] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:15.159280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:15.170621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15717f9-66f3-46f0-b418-64c9b162e152 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:15.174247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94536b-7169-425c-99c7-133b27d3269a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:15.174918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94536b-7169-425c-99c7-133b27d3269a service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:15.175202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94536b-7169-425c-99c7-133b27d3269a service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:15.175478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94536b-7169-425c-99c7-133b27d3269a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:15.184762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94536b-7169-425c-99c7-133b27d3269a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:15.186176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94536b-7169-425c-99c7-133b27d3269a service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:15.198180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 918/1838] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:21.589314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:25.192245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:30.758312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:30.860793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854dba5-d302-4e14-a422-9f4fcedb71cb service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:30.865664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:30.867068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:30.867494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:30.867612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] PATH_INFO: `/v3/users/82e45cb69d5e4a54be2628807345dddf` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:30.868929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e45cb69d5e4a54be2628807345dddf)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:30.870922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:31.082235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e45cb69d5e4a54be2628807345dddf'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:31.083070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e45cb69d5e4a54be2628807345dddf'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:31.147097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e45cb69d5e4a54be2628807345dddf'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:31.159668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e45cb69d5e4a54be2628807345dddf'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:31.183899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e45cb69d5e4a54be2628807345dddf'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:31.192284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 921/1839] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:30 2022] DELETE /identity/v3/users/82e45cb69d5e4a54be2628807345dddf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:31.198069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:31.198638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:31.199027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:31.233088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:31.234468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:31.297467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 919/1840] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:31.307220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:31.308782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:31.370718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3da6a-9eb0-4ca1-8645-ce33c5fd54b2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:31.374575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:31.375254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:31.375544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:31.375824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:31.385740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:31.387235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:31.396892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 922/1841] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:31.834693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:31.836209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:31.866439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f313ed-b16c-416e-ae7d-c5f9970e8e6d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:31.880899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:31.881898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:31.883851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:31.883851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] PATH_INFO: `/v3/projects/b9ca49393e4f45ae9c26ae907a2c7cbe` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:31.884784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ca49393e4f45ae9c26ae907a2c7cbe)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:31.892163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:31.993906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ca49393e4f45ae9c26ae907a2c7cbe', 'request_id': 'req-5bce2a86-4c88-4042-a22c-bba24e832c22'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.003265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ca49393e4f45ae9c26ae907a2c7cbe', 'request_id': 'req-5bce2a86-4c88-4042-a22c-bba24e832c22'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.067087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ca49393e4f45ae9c26ae907a2c7cbe', 'request_id': 'req-5bce2a86-4c88-4042-a22c-bba24e832c22'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.081449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] The token cache is being invalidate because project b9ca49393e4f45ae9c26ae907a2c7cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:32.081449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.081449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.083808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 920/1842] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:31 2022] DELETE /identity/v3/projects/b9ca49393e4f45ae9c26ae907a2c7cbe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:32.087809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:32.105006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bbae-cb94-4b06-a735-8eb10cda8384 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:32.126059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:32.183779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:32.184685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:32.184961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:32.185232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] PATH_INFO: `/v3/users/8d490495f51e4dd38cf5f161d790f9b7` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:32.186691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d490495f51e4dd38cf5f161d790f9b7)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:32.188605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:32.417276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d490495f51e4dd38cf5f161d790f9b7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.420149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d490495f51e4dd38cf5f161d790f9b7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.489788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d490495f51e4dd38cf5f161d790f9b7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.498193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d490495f51e4dd38cf5f161d790f9b7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.510972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d490495f51e4dd38cf5f161d790f9b7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:32.523767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 923/1843] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:32 2022] DELETE /identity/v3/users/8d490495f51e4dd38cf5f161d790f9b7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:32.982325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:32.984141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:32.999747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce2a86-4c88-4042-a22c-bba24e832c22 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.072910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.074702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:33.075104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.076167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.081218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.081218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] PATH_INFO: `/v3/users/abdd22fae3fc4202b1718aa8406dc221` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.081218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abdd22fae3fc4202b1718aa8406dc221)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.081218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.088236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83708635-9f04-4b9f-b1de-7b41dc20eeb2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.093355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.094333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.094840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.095258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] PATH_INFO: `/v3/projects/bb5e9c68173c4d528a3dc170f7e2e126` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.096927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5e9c68173c4d528a3dc170f7e2e126)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.099308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.199558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:33.327919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5e9c68173c4d528a3dc170f7e2e126', 'request_id': 'req-ecb8667b-8364-4a36-b195-4ee388be2bf1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.330482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abdd22fae3fc4202b1718aa8406dc221'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.331365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abdd22fae3fc4202b1718aa8406dc221'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.338312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5e9c68173c4d528a3dc170f7e2e126', 'request_id': 'req-ecb8667b-8364-4a36-b195-4ee388be2bf1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.355228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abdd22fae3fc4202b1718aa8406dc221'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.382539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5e9c68173c4d528a3dc170f7e2e126', 'request_id': 'req-ecb8667b-8364-4a36-b195-4ee388be2bf1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.398034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] The token cache is being invalidate because project bb5e9c68173c4d528a3dc170f7e2e126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:33.398331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.399269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ecb8667b-8364-4a36-b195-4ee388be2bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.400869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 924/1844] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:33 2022] DELETE /identity/v3/projects/bb5e9c68173c4d528a3dc170f7e2e126 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:33.406035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a434e-e442-4b63-bf48-d2d2ead35c07 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.406318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a434e-e442-4b63-bf48-d2d2ead35c07 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.406780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a434e-e442-4b63-bf48-d2d2ead35c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.421631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abdd22fae3fc4202b1718aa8406dc221'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.428401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e27a434e-e442-4b63-bf48-d2d2ead35c07 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:33.431097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e27a434e-e442-4b63-bf48-d2d2ead35c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:33.437896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-34dbb47a-0c75-427d-97f5-368e3cf69e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abdd22fae3fc4202b1718aa8406dc221'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:33.445683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 921/1845] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:32 2022] DELETE /identity/v3/users/abdd22fae3fc4202b1718aa8406dc221 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:33.450341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.451190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.451190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.453743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:33.471306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:33.472891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:33.503838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 925/1846] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:33.512623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.513316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.513845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.545806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:33.547366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:33.550687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 922/1847] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:33.557161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 926/1848] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:33.561644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.563115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.565956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:33.576211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0eda7-4847-4288-b52e-e8754e06201f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.581980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.582689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.583008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.583577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.584066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:33.584401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.586450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.602668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 923/1849] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:57:33.609544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.620735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc121a2-ab94-4376-985e-40352e20c094 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.625493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.630215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.630215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.630215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.630215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.630555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eef2d-b7f9-4b97-a3ad-67e0b678b3f5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.630671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.632650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.633258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.633540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.633824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.643322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.644750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.654710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 927/1850] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:33.720133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 924/1851] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:33 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:33.721554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.732557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346826be-45b8-4ced-a3d6-0c0ec4cb5195 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.793958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.794555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.794865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.795141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.795822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.797766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.886715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 928/1852] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:33 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:33.890569 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.901942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dbd64-343b-46b6-a698-1f4fe905db1f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.906883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.910964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.910964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.910964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.910964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.910964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.921751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 925/1853] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:33.925954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.936690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771ae6-ad9f-42b3-9fc3-feedc5c0e36b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.941721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf9927-6c7e-4f84-80c6-8dd97a90686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.942385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf9927-6c7e-4f84-80c6-8dd97a90686e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.942706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf9927-6c7e-4f84-80c6-8dd97a90686e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.942991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf9927-6c7e-4f84-80c6-8dd97a90686e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:33.943802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf9927-6c7e-4f84-80c6-8dd97a90686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:33.946214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf9927-6c7e-4f84-80c6-8dd97a90686e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:33.967472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 929/1854] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:33.968734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:33.980085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ac5b-ad3b-4575-bfde-7d1173c78a7b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:33.985392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:33.986290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:33.986822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:33.987101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] PATH_INFO: `/v3/projects/1a3b8bcb6a4f41c89423c21ec9f5b4df/users/1fff36eb6afa409da7c0969bc1c4bdce/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.005267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3b8bcb6a4f41c89423c21ec9f5b4df, user_id=1fff36eb6afa409da7c0969bc1c4bdce, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.008629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.086892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 926/1855] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:33 2022] PUT /identity/v3/projects/1a3b8bcb6a4f41c89423c21ec9f5b4df/users/1fff36eb6afa409da7c0969bc1c4bdce/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:34.095857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.097120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.097702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.132185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.138850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:34.166940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] MFA Rules not processed for user `1fff36eb6afa409da7c0969bc1c4bdce`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:34.169642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:34.204182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:34.218469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:34.276335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e321f-14ae-43a9-a82f-322a4a79c8ec admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.282342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:34.283495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.283924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.284343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] PATH_INFO: `/v3/projects/c31415de7ed3439da21061b34086b4cb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.286304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31415de7ed3439da21061b34086b4cb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.290722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.293246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 930/1856] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:34.297787 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.316921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211b7ed-ebd1-437b-9ca4-789e9c1ee6f6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.327445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:34.328419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.328846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.329255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.334844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.336577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.422852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31415de7ed3439da21061b34086b4cb', 'request_id': 'req-32103048-62d3-485c-93d3-50c437113c50'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.429590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31415de7ed3439da21061b34086b4cb', 'request_id': 'req-32103048-62d3-485c-93d3-50c437113c50'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.472788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 931/1857] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:34 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:34.473728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.484815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31415de7ed3439da21061b34086b4cb', 'request_id': 'req-32103048-62d3-485c-93d3-50c437113c50'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.499743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] The token cache is being invalidate because project c31415de7ed3439da21061b34086b4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:34.500077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.500768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.502558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 927/1858] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:34 2022] DELETE /identity/v3/projects/c31415de7ed3439da21061b34086b4cb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:34.507065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.509141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:34.558684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74660-0591-4a17-893e-c007bb8bfcfe admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.561139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:34.561756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.562015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.562296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.563088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.565251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.640681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103048-62d3-485c-93d3-50c437113c50 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.647046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:34.648609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.648956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.649349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] PATH_INFO: `/v3/users/721a4d8035e84dabac2d350afcdf93e7` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.650708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721a4d8035e84dabac2d350afcdf93e7)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.660759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.679368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 932/1859] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:34 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:34.684543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.687094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:34.710047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ca77-450e-4639-aeef-677d0e10b92e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.715271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:34.716139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.716487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.716831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.717714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.719736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.731232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 933/1860] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:34.735183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.745094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26579e-ef36-46d3-8d5d-19e296a16431 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.749703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:34.750572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:34.750887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:34.751166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] PATH_INFO: `/v3/projects/05c0a00bf9e74f49a1efda3fbedf03bb/users/b2472c5f260f488194fef45dec2feda7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:34.766892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c0a00bf9e74f49a1efda3fbedf03bb, user_id=b2472c5f260f488194fef45dec2feda7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:34.769689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:34.847074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721a4d8035e84dabac2d350afcdf93e7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.847742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721a4d8035e84dabac2d350afcdf93e7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.857212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 934/1861] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:34 2022] PUT /identity/v3/projects/05c0a00bf9e74f49a1efda3fbedf03bb/users/b2472c5f260f488194fef45dec2feda7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:34.861109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721a4d8035e84dabac2d350afcdf93e7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.862689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.924492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721a4d8035e84dabac2d350afcdf93e7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.926552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:34.940511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721a4d8035e84dabac2d350afcdf93e7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:34.953453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 928/1862] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:34 2022] DELETE /identity/v3/users/721a4d8035e84dabac2d350afcdf93e7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:34.953453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:34.963387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0458a-55a9-4636-a30c-bb903dbe936e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:34.966033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:34.970084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:35.048581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.049338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.049677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.050021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.051050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.053002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.053248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24533-400d-4133-b7f5-52429c98ddb4 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.060974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.062165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.063277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.063812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] PATH_INFO: `/v3/users/74a385bb185540399cffa8895a7a3816` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.065172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 935/1863] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:35.065660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a385bb185540399cffa8895a7a3816)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.067996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.069334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.072249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.089285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533958f4-5156-4836-8cdc-7236a2cd993b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.095023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f3de-eb56-4b50-9c01-13a682e09b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.107634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f3de-eb56-4b50-9c01-13a682e09b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.108318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f3de-eb56-4b50-9c01-13a682e09b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.108318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f3de-eb56-4b50-9c01-13a682e09b8a admin admin] PATH_INFO: `/v3/projects/05c0a00bf9e74f49a1efda3fbedf03bb/users/b2472c5f260f488194fef45dec2feda7/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.110714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f3de-eb56-4b50-9c01-13a682e09b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c0a00bf9e74f49a1efda3fbedf03bb, user_id=b2472c5f260f488194fef45dec2feda7, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.113562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f3de-eb56-4b50-9c01-13a682e09b8a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.125275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 936/1864] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:35 2022] PUT /identity/v3/projects/05c0a00bf9e74f49a1efda3fbedf03bb/users/b2472c5f260f488194fef45dec2feda7/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:35.137141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.137439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.137721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.166649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] MFA Rules not processed for user `b2472c5f260f488194fef45dec2feda7`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:35.167902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.253150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 937/1865] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:35.261198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a385bb185540399cffa8895a7a3816'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.261366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.262038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a385bb185540399cffa8895a7a3816'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.262798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.274045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a385bb185540399cffa8895a7a3816'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.329800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a385bb185540399cffa8895a7a3816'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.334290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce974586-5057-4d7b-8b27-ccac070e8a41 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.339269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.342240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.342240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.342240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.352677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.354568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.356111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a385bb185540399cffa8895a7a3816'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.363204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 929/1866] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:34 2022] DELETE /identity/v3/users/74a385bb185540399cffa8895a7a3816 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:35.374667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 938/1867] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:35.400974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.402680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.492463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86702e4d-20f3-41ec-bfad-2bcdb49a8bfa admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.497130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.498154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.502794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.502794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] PATH_INFO: `/v3/projects/f5bec14298594b76b3d6d6de848ab661` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.502794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bec14298594b76b3d6d6de848ab661)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.502794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.504455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:35.551732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.560054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71e63-5855-49ba-92ea-c414a34c307e service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.577532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:35.619817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.620492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.620774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.621075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.622857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.629217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bec14298594b76b3d6d6de848ab661', 'request_id': 'req-c42ed708-7a60-4825-9ef5-a1336697afd9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.635229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bec14298594b76b3d6d6de848ab661', 'request_id': 'req-c42ed708-7a60-4825-9ef5-a1336697afd9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.703605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.705046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.715969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 939/1868] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:35.716803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.718095 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.732775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9581-dda3-4aca-a985-676f33d3d1f7 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.745449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bec14298594b76b3d6d6de848ab661', 'request_id': 'req-c42ed708-7a60-4825-9ef5-a1336697afd9'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.759881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] The token cache is being invalidate because project f5bec14298594b76b3d6d6de848ab661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:35.760175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.760985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c42ed708-7a60-4825-9ef5-a1336697afd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.762900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 930/1869] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:35 2022] DELETE /identity/v3/projects/f5bec14298594b76b3d6d6de848ab661 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:35.767662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d9be-93e9-4d98-bdc2-d35171d22c5f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.767959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d9be-93e9-4d98-bdc2-d35171d22c5f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.768239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d9be-93e9-4d98-bdc2-d35171d22c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.786492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-0034d9be-93e9-4d98-bdc2-d35171d22c5f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:35.790726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0034d9be-93e9-4d98-bdc2-d35171d22c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.796194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.797100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.797380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.797660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] PATH_INFO: `/v3/projects/e2c441eff5ca4c409fa4a6fb890c873c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.798878 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c441eff5ca4c409fa4a6fb890c873c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.800823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.858890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 931/1870] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:35.862711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.863013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.863293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.881684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:35.883007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:35.891315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 932/1871] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:35.895498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.905252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a43ca-fc9e-47af-98fa-76c6552e07b2 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.909893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.910455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.910778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.911057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.911759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:35.912060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:35.914229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:35.928967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 933/1872] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:57:35.929928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:35.939273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8677-a0a8-4b4e-a5af-a6472f915d92 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:35.942473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c441eff5ca4c409fa4a6fb890c873c', 'request_id': 'req-2e112d60-8f9f-41e3-b5fc-d76aad56103b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.948791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c441eff5ca4c409fa4a6fb890c873c', 'request_id': 'req-2e112d60-8f9f-41e3-b5fc-d76aad56103b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:35.996776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:35.997426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:35.997709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:35.997985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:35.998698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.000593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.043709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c441eff5ca4c409fa4a6fb890c873c', 'request_id': 'req-2e112d60-8f9f-41e3-b5fc-d76aad56103b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:36.055580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] The token cache is being invalidate because project e2c441eff5ca4c409fa4a6fb890c873c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:36.055871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:36.056518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2e112d60-8f9f-41e3-b5fc-d76aad56103b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:36.058180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 940/1873] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:35 2022] DELETE /identity/v3/projects/e2c441eff5ca4c409fa4a6fb890c873c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:36.062998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31d44-c46b-4607-8c25-a0774bd476e9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.063289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31d44-c46b-4607-8c25-a0774bd476e9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.063575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31d44-c46b-4607-8c25-a0774bd476e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.070528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:36.081442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-35a31d44-c46b-4607-8c25-a0774bd476e9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:36.082684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-35a31d44-c46b-4607-8c25-a0774bd476e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:36.091170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 941/1874] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:36.098936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.099226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.099503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.108012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:36.119286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 934/1875] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:36.120588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.122240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:36.126353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:36.127619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:36.189127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 942/1876] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:36.193346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e576-bca7-4aca-9277-afb8d0afdf22 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.196313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.201053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.201053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.201053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.201053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.201605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.204199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.207549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396d9d-c2a0-44b6-b5ad-2c78540d510f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.212617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.213286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.213598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.213960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.214651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:36.214970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.216610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.230225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 943/1877] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:36.234256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.244288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5dd8-6f7e-4b04-af07-843995b30106 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.249112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.249773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.250058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.250338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.251056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.252931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.301538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 935/1878] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:36.305961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.315568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744f31-b59e-4e0e-9591-c26e3de291c3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.320936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.321575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.321861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.322137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.322966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.324607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.334345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 936/1879] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:36.337939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.347444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59482b-c841-4cd9-9ab5-2b64ec0876cc admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.348388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 944/1880] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:36.352869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.427961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.429862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.430220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.430647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.431425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.433023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.445499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 937/1881] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:36.445997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af62ca5-0bdb-4514-adb3-cb3dbb0ef82c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.447240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.451154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a65a-ed0f-4aa4-921e-dd6b20d3670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.451823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a65a-ed0f-4aa4-921e-dd6b20d3670c admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.452113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a65a-ed0f-4aa4-921e-dd6b20d3670c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.452397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a65a-ed0f-4aa4-921e-dd6b20d3670c admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.453125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a65a-ed0f-4aa4-921e-dd6b20d3670c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.455243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a65a-ed0f-4aa4-921e-dd6b20d3670c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.457723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d673-7222-4106-84c9-79a75f8f5a17 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.462566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.463655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.464345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.464345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] PATH_INFO: `/v3/projects/db7300c066fd4d91956b7a544537e79c/users/8b9dfb26f63c48a0a425feb33ce9c325/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.481047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7300c066fd4d91956b7a544537e79c, user_id=8b9dfb26f63c48a0a425feb33ce9c325, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.483946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.536001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 938/1882] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:36 2022] PUT /identity/v3/projects/db7300c066fd4d91956b7a544537e79c/users/8b9dfb26f63c48a0a425feb33ce9c325/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:36.536210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 945/1883] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:36.540362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.547339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.547824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.548912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.576012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] MFA Rules not processed for user `8b9dfb26f63c48a0a425feb33ce9c325`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:36.577243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:36.602928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7874a-e8e1-49a9-8c38-8afc5e9d53b6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.608337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.608810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.609099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.609376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.610105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.611777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.622453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 939/1884] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:36.624358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:36.630677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.635960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa63f-5fdc-4f55-9e5b-b3ab36ffbe8b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.641291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.641938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.642223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.642498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.643262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.644838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.648440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 946/1885] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:36.652694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.657143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 940/1886] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:36.663378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.664176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0fe7-c524-441a-a1cd-c918525f651c None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.668899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83378c5a-2350-440d-8f95-831c0d14561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.669609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83378c5a-2350-440d-8f95-831c0d14561f admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.670373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83378c5a-2350-440d-8f95-831c0d14561f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.670373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83378c5a-2350-440d-8f95-831c0d14561f admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.670871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83378c5a-2350-440d-8f95-831c0d14561f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.672848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83378c5a-2350-440d-8f95-831c0d14561f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.673557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ef049-ea00-4639-95f8-97dd9c942e30 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.678793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.679731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.680155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.680433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] PATH_INFO: `/v3/projects/692ccd10b18d43abb2c2ea122b685492/users/7a3f13224ea14197ac048b82596ea8e2/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.693055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:36.700790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692ccd10b18d43abb2c2ea122b685492, user_id=7a3f13224ea14197ac048b82596ea8e2, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.702128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:36.787736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 941/1887] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:36 2022] PUT /identity/v3/projects/692ccd10b18d43abb2c2ea122b685492/users/7a3f13224ea14197ac048b82596ea8e2/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:36.789360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 947/1888] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:36.793151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.797629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.797978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.798998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.835344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] MFA Rules not processed for user `7a3f13224ea14197ac048b82596ea8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:36.838208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:36.879335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848877-7b68-4018-bd17-34d814160e25 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:36.935088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 948/1889] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:36.939426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:36.956380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:36.957059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:36.957353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:36.957640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:36.958315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:36.960235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.003355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d934025-5f5f-4ccd-a414-322315748885 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.008171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.008629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.008912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.009187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.009866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.011780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.055594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 942/1890] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:37.059461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.069002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95940-1099-4674-a702-b33905eea0c1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.074341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.075148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.076511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.076511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.076511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.078073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.089138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 943/1891] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:37.092857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.103672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468ab36-c884-4cd9-a1c9-03c9e6a4abaf admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.108399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.109253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.109538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.109818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] PATH_INFO: `/v3/projects/4c775d172d5a47c9825d19af6b928944/users/56ed7f6e5e334c5bb384672a331603e8/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.116836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 949/1892] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:36 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:37.117793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.125242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c775d172d5a47c9825d19af6b928944, user_id=56ed7f6e5e334c5bb384672a331603e8, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.128021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.158003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:37.179319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf525a5-3356-46b9-947f-c5c464888a62 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.183933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.184588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.184871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.185197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.185872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.187821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.227301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 944/1893] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:37 2022] PUT /identity/v3/projects/4c775d172d5a47c9825d19af6b928944/users/56ed7f6e5e334c5bb384672a331603e8/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:37.231123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.242936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:37.281675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 950/1894] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:37 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:37.282872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.291963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1adb30-b060-4389-8e1c-31d6c6a6a5ee admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.292473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa0b36-4dd1-41db-bb78-0c0c40f80029 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.296974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.297273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.297640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.297925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.298016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.298207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.298299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.298492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.298975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.299281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.300762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.301216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.311171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 945/1895] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:37.314526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 951/1896] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:37.315215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.316431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.325570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8a50-56ed-4f2c-8a7a-0c593d5adb4e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.326449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87910f5-26fe-40f9-9fb9-76065f572b7f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.330654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb0e66-d129-4033-adca-890cbe2c721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.331281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.331553 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb0e66-d129-4033-adca-890cbe2c721a admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.331842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb0e66-d129-4033-adca-890cbe2c721a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.332125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb0e66-d129-4033-adca-890cbe2c721a admin admin] PATH_INFO: `/v3/projects/4c775d172d5a47c9825d19af6b928944/users/56ed7f6e5e334c5bb384672a331603e8/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.332215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.332403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.332677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] PATH_INFO: `/v3/projects/fe8a99095a0e46279e986049b4bb56a9/users/a18c4d1694ed4c4eafb61380fa08a7dc/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.334114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb0e66-d129-4033-adca-890cbe2c721a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c775d172d5a47c9825d19af6b928944, user_id=56ed7f6e5e334c5bb384672a331603e8, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.337404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb0e66-d129-4033-adca-890cbe2c721a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.347684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8a99095a0e46279e986049b4bb56a9, user_id=a18c4d1694ed4c4eafb61380fa08a7dc, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.349058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 952/1897] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:37 2022] PUT /identity/v3/projects/4c775d172d5a47c9825d19af6b928944/users/56ed7f6e5e334c5bb384672a331603e8/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:37.350301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.359175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.359469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.359749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.384968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] MFA Rules not processed for user `56ed7f6e5e334c5bb384672a331603e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:37.386167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:37.410108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 946/1898] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:37 2022] PUT /identity/v3/projects/fe8a99095a0e46279e986049b4bb56a9/users/a18c4d1694ed4c4eafb61380fa08a7dc/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:37.413920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.461743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 953/1899] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:37.479224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.480646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:37.493643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b86d-d5b4-4f0c-b61a-9577583f633d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.508539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.509584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.510096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.510565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.515011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.516707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.532712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 947/1900] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:37.533374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.546609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ac67-1813-4fc4-946b-19083c36bdef admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.548272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f757-b449-4421-935d-aa9fe5850ea3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.552224 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235de0-0018-49f3-b650-22fbf27e322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.553767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235de0-0018-49f3-b650-22fbf27e322f admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.554050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235de0-0018-49f3-b650-22fbf27e322f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.554882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235de0-0018-49f3-b650-22fbf27e322f admin admin] PATH_INFO: `/v3/projects/fe8a99095a0e46279e986049b4bb56a9/users/a18c4d1694ed4c4eafb61380fa08a7dc/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.556861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235de0-0018-49f3-b650-22fbf27e322f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8a99095a0e46279e986049b4bb56a9, user_id=a18c4d1694ed4c4eafb61380fa08a7dc, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.559495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235de0-0018-49f3-b650-22fbf27e322f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.572423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 948/1901] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:37 2022] PUT /identity/v3/projects/fe8a99095a0e46279e986049b4bb56a9/users/a18c4d1694ed4c4eafb61380fa08a7dc/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:37.583717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.584075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.584440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.595557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:37.605055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.605696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.605979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.606254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.611287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] MFA Rules not processed for user `a18c4d1694ed4c4eafb61380fa08a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:37.612510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:37.668731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.670287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.671656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:37.680498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 954/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:37.689832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 949/1903] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:37.801822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:37.810982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dbde8-4916-4e7c-b4cf-2cb71528bb7e service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:37.858739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:37.859383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:37.859686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:37.859968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:37.869986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:37.871491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:37.881468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 955/1904] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:38.110037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:38.111551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:38.123766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89602a7a-23f5-4d81-95be-f3ee970460cd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:38.127248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b114dc9-6d20-4cf8-ac36-aed5917a6075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:38.127881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b114dc9-6d20-4cf8-ac36-aed5917a6075 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:38.128157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b114dc9-6d20-4cf8-ac36-aed5917a6075 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:38.128426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b114dc9-6d20-4cf8-ac36-aed5917a6075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:38.187062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b114dc9-6d20-4cf8-ac36-aed5917a6075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:38.188516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b114dc9-6d20-4cf8-ac36-aed5917a6075 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:38.197648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 950/1905] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:38.861257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:38.928145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e61aa0-e753-4c72-bffe-990f8160b7ba service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:38.932907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:38.933780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:38.934130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:38.934409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] PATH_INFO: `/v3/users/8b9dfb26f63c48a0a425feb33ce9c325` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:38.935672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9dfb26f63c48a0a425feb33ce9c325)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:38.937601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:39.092265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:39.098176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9dfb26f63c48a0a425feb33ce9c325'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:39.098866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9dfb26f63c48a0a425feb33ce9c325'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:39.169711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9dfb26f63c48a0a425feb33ce9c325'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:39.181494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9dfb26f63c48a0a425feb33ce9c325'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:39.197638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9dfb26f63c48a0a425feb33ce9c325'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:39.205207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 956/1906] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:38 2022] DELETE /identity/v3/users/8b9dfb26f63c48a0a425feb33ce9c325 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:39.209767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:39.211495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:39.211495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:39.229206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:39.230431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:39.298897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 951/1907] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:39.308173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:39.309581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:39.367587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f0fe-4957-4496-99a2-c03dec5f8116 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:39.371281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:39.371923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:39.372209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:39.372486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:39.381396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:39.383405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:39.393888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 957/1908] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:39.835249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:39.840582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:39.873008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9a050-8b5e-4df5-892f-d72e6d8194c2 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:39.889153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:39.891125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:39.891898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:39.892526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] PATH_INFO: `/v3/projects/db7300c066fd4d91956b7a544537e79c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:39.895392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7300c066fd4d91956b7a544537e79c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:39.901202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:40.053772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7300c066fd4d91956b7a544537e79c', 'request_id': 'req-40511a44-4754-44e4-9eb4-5d9357d86b56'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.061935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7300c066fd4d91956b7a544537e79c', 'request_id': 'req-40511a44-4754-44e4-9eb4-5d9357d86b56'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.146871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7300c066fd4d91956b7a544537e79c', 'request_id': 'req-40511a44-4754-44e4-9eb4-5d9357d86b56'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.160750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] The token cache is being invalidate because project db7300c066fd4d91956b7a544537e79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:40.161236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.162140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.164988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 952/1909] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:39 2022] DELETE /identity/v3/projects/db7300c066fd4d91956b7a544537e79c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:40.169581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:40.181279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6bc5-fd53-4799-9d7c-aecbd7ee1727 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:40.240736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:40.241612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:40.241925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:40.242760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] PATH_INFO: `/v3/users/56ed7f6e5e334c5bb384672a331603e8` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:40.243959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ed7f6e5e334c5bb384672a331603e8)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:40.245875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:40.462474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ed7f6e5e334c5bb384672a331603e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.462474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ed7f6e5e334c5bb384672a331603e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.541208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ed7f6e5e334c5bb384672a331603e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.554211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:40.554211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ed7f6e5e334c5bb384672a331603e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.569169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b59d5cec-bb5a-4692-a89e-591c34af3d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ed7f6e5e334c5bb384672a331603e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:40.575316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 958/1910] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:40 2022] DELETE /identity/v3/users/56ed7f6e5e334c5bb384672a331603e8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:40.983201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:40.985110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:41.001977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40511a44-4754-44e4-9eb4-5d9357d86b56 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.013776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:41.062211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.063138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.063416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.063683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] PATH_INFO: `/v3/projects/4c775d172d5a47c9825d19af6b928944` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.065022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c775d172d5a47c9825d19af6b928944)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.067326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.176409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c775d172d5a47c9825d19af6b928944', 'request_id': 'req-cfac88c3-a060-4c39-8420-70206050895e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:41.181959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c775d172d5a47c9825d19af6b928944', 'request_id': 'req-cfac88c3-a060-4c39-8420-70206050895e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:41.272067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c775d172d5a47c9825d19af6b928944', 'request_id': 'req-cfac88c3-a060-4c39-8420-70206050895e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:41.283955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] The token cache is being invalidate because project 4c775d172d5a47c9825d19af6b928944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:41.284271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:41.284902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cfac88c3-a060-4c39-8420-70206050895e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:41.286442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 953/1911] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:40 2022] DELETE /identity/v3/projects/4c775d172d5a47c9825d19af6b928944 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:41.292140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.292644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.292866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.310041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:41.311278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:41.370149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 959/1912] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:41.378092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.378383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.378707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.396898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:41.398110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:41.406698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 954/1913] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:41.410814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.421139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68512f47-bb05-4e76-9302-5cf842bf1cf5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.425744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.426384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.426698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.426975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.427698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:41.428002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.429591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.440919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 960/1914] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:41.445004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.454080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fad32a-43e1-48bd-9fc3-0ac92be6fa64 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.458765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.459444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.459737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.460016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.461207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.463195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.566326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 955/1915] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:41 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:41.570923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.585423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417986-b10b-47e8-8022-f01cb3840706 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.645389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.646086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.646368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.646673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.647351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.649942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.709545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 961/1916] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:41 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:41.717605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.725965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deef7a3-bccf-492d-914a-dddabdae665f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.731430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.732327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.732617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.732903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.733637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.735337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.746063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 956/1917] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:41.750247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.760794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2521-5fed-4a18-9784-c2274d9b73b7 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.765606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.766245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.766528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.766839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.767566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.769160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.779646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 962/1918] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:41.783664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.800088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a852-153f-475c-b5f7-c61479ac9b5c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.800088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb3fb-5b88-488f-982c-0493eb7ef02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.800088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb3fb-5b88-488f-982c-0493eb7ef02c admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.800088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb3fb-5b88-488f-982c-0493eb7ef02c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.800568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb3fb-5b88-488f-982c-0493eb7ef02c admin admin] PATH_INFO: `/v3/projects/4e02a419d4e243b699ea8091247fb83f/users/f75659e538e344fcb81f2a14d2f20bd3/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.815132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb3fb-5b88-488f-982c-0493eb7ef02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e02a419d4e243b699ea8091247fb83f, user_id=f75659e538e344fcb81f2a14d2f20bd3, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.818279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb3fb-5b88-488f-982c-0493eb7ef02c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.818608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:41.821025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:41.833548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b7bf-50ac-4dff-9134-da4138f39fcf admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:41.838735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:41.839593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.839874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.840152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] PATH_INFO: `/v3/users/7a3f13224ea14197ac048b82596ea8e2` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.841340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3f13224ea14197ac048b82596ea8e2)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:41.843276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:41.884107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 957/1919] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:41 2022] PUT /identity/v3/projects/4e02a419d4e243b699ea8091247fb83f/users/f75659e538e344fcb81f2a14d2f20bd3/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:41.895179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:41.895467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:41.895741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:41.922391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] MFA Rules not processed for user `f75659e538e344fcb81f2a14d2f20bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:41.923612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:41.955533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:41.997197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 958/1920] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:42.001535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.044932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:42.057441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3f13224ea14197ac048b82596ea8e2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.058181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3f13224ea14197ac048b82596ea8e2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.066830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03102c53-aa73-47bd-b66b-98b73139f69b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.072749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.073567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.073852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.077167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.077167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.077167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.123652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3f13224ea14197ac048b82596ea8e2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.130873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3f13224ea14197ac048b82596ea8e2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.143003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d857f195-0262-4d1f-b7f1-8acb3e78b793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3f13224ea14197ac048b82596ea8e2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.148806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 963/1921] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:41 2022] DELETE /identity/v3/users/7a3f13224ea14197ac048b82596ea8e2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:42.153333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cf090-f321-437b-827a-70851a042101 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.153899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cf090-f321-437b-827a-70851a042101 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.157393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cf090-f321-437b-827a-70851a042101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.161877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 959/1922] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:42 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:42.167180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.169499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.173744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9b6cf090-f321-437b-827a-70851a042101 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:42.174968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9b6cf090-f321-437b-827a-70851a042101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.237631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 964/1923] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:42.247903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cf090-f321-437b-827a-70851a042101 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.248080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1935f-2400-4221-b844-4696d97b01ef admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.249239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9b6cf090-f321-437b-827a-70851a042101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.252801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.253466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.253788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.254039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.254763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.256688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.309096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cf090-f321-437b-827a-70851a042101 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.312742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.314631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.314934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.315250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.326631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.328070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.337347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 965/1924] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:42.338114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.339416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.352439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916781b3-d981-46db-ac07-6d6edb0438e7 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.357269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.358124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.358408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.358719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] PATH_INFO: `/v3/users/1fff36eb6afa409da7c0969bc1c4bdce` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.359914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fff36eb6afa409da7c0969bc1c4bdce)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.361817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.376019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 960/1925] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:42 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:42.380162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.391745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432989c0-8bcb-421e-b641-6b4ce798847b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.396704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.397497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.397785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.398656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.399399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.400997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.411722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 961/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:42.417923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.426058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abfc55-29af-4772-acb0-ce090dbeb64f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.431285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.432147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.432433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.432710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] PATH_INFO: `/v3/projects/56bd5f0ebcbc4f2381e6b138ba06439c/users/a029f8b16e0b45b9a43993e96c5c955f/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.447900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bd5f0ebcbc4f2381e6b138ba06439c, user_id=a029f8b16e0b45b9a43993e96c5c955f, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.450602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.524344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 962/1927] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:42 2022] PUT /identity/v3/projects/56bd5f0ebcbc4f2381e6b138ba06439c/users/a029f8b16e0b45b9a43993e96c5c955f/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:42.528954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.541788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:42.598230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50024be-2231-4cf9-8b29-c879dd6e3b9b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.603967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.605161 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.605729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.605729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.606434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.609436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.622147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fff36eb6afa409da7c0969bc1c4bdce'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.623139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fff36eb6afa409da7c0969bc1c4bdce'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.623359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 963/1928] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:42.626840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:42.627658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.643898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d7ef-4837-4c33-8dd7-db33511e047c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.650442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48b274-3b99-4777-abee-c50ad4d4e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.651339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48b274-3b99-4777-abee-c50ad4d4e465 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.651629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48b274-3b99-4777-abee-c50ad4d4e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.651907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48b274-3b99-4777-abee-c50ad4d4e465 admin admin] PATH_INFO: `/v3/projects/56bd5f0ebcbc4f2381e6b138ba06439c/users/a029f8b16e0b45b9a43993e96c5c955f/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.653901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48b274-3b99-4777-abee-c50ad4d4e465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bd5f0ebcbc4f2381e6b138ba06439c, user_id=a029f8b16e0b45b9a43993e96c5c955f, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.656753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48b274-3b99-4777-abee-c50ad4d4e465 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.668860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 964/1929] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:42 2022] PUT /identity/v3/projects/56bd5f0ebcbc4f2381e6b138ba06439c/users/a029f8b16e0b45b9a43993e96c5c955f/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:42.679241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28968-96fc-4007-a498-584a4153e720 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.679562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28968-96fc-4007-a498-584a4153e720 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.679840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28968-96fc-4007-a498-584a4153e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.689674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fff36eb6afa409da7c0969bc1c4bdce'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.702853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fff36eb6afa409da7c0969bc1c4bdce'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.708401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-21d28968-96fc-4007-a498-584a4153e720 None None] MFA Rules not processed for user `a029f8b16e0b45b9a43993e96c5c955f`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:42.709636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-21d28968-96fc-4007-a498-584a4153e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.718734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ce8c1cc1-2eae-4f57-97d8-d48e9e75af34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fff36eb6afa409da7c0969bc1c4bdce'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:42.727754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 966/1930] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:42 2022] DELETE /identity/v3/users/1fff36eb6afa409da7c0969bc1c4bdce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:42.732970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.733292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.733711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.753402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:42.757284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.803648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 965/1931] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:42.806337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28968-96fc-4007-a498-584a4153e720 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.806337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-21d28968-96fc-4007-a498-584a4153e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.831557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 967/1932] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:42.836228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.837802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.889560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28968-96fc-4007-a498-584a4153e720 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.894536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.895436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.895714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.895983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] PATH_INFO: `/v3/projects/692ccd10b18d43abb2c2ea122b685492` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.897169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=692ccd10b18d43abb2c2ea122b685492)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.899726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.919707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b54ef-783e-4dff-8c7d-460458e50f29 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:42.923528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:42.924180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:42.924462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:42.924741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:42.926557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:42.985114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:42.986557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:42.995630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 968/1933] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:42.996405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:42.997698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:43.028751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692ccd10b18d43abb2c2ea122b685492', 'request_id': 'req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.035770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692ccd10b18d43abb2c2ea122b685492', 'request_id': 'req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.059405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514cfc-1fc2-4439-9626-075688b453c3 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:43.108304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:43.108949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:43.109550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:43.109833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:43.135514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:43.168468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:43.169893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:43.179275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 969/1934] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:43.180761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692ccd10b18d43abb2c2ea122b685492', 'request_id': 'req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.192379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] The token cache is being invalidate because project 692ccd10b18d43abb2c2ea122b685492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:43.192632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.193291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.195619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 966/1935] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:42 2022] DELETE /identity/v3/projects/692ccd10b18d43abb2c2ea122b685492 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:43.199314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:43.209692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa214dfa-6287-48a6-b928-cca917a143cf service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:43.215812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:43.216774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:43.217083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:43.217360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] PATH_INFO: `/v3/users/a18c4d1694ed4c4eafb61380fa08a7dc` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:43.218577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18c4d1694ed4c4eafb61380fa08a7dc)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:43.220523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:43.411208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18c4d1694ed4c4eafb61380fa08a7dc'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.411906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18c4d1694ed4c4eafb61380fa08a7dc'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.466615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18c4d1694ed4c4eafb61380fa08a7dc'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.474601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18c4d1694ed4c4eafb61380fa08a7dc'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.487310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18c4d1694ed4c4eafb61380fa08a7dc'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.494081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 970/1936] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:43 2022] DELETE /identity/v3/users/a18c4d1694ed4c4eafb61380fa08a7dc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:43.530343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:43.565084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:43.567308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:43.588574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf65dc6-2f26-4148-8c47-e7b4aec07bfb admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:43.651240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:43.652157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:43.652433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:43.652704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] PATH_INFO: `/v3/projects/1a3b8bcb6a4f41c89423c21ec9f5b4df` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:43.654010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3b8bcb6a4f41c89423c21ec9f5b4df)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:43.655999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:43.752946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3b8bcb6a4f41c89423c21ec9f5b4df', 'request_id': 'req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.759491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3b8bcb6a4f41c89423c21ec9f5b4df', 'request_id': 'req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.849421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3b8bcb6a4f41c89423c21ec9f5b4df', 'request_id': 'req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.868305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] The token cache is being invalidate because project 1a3b8bcb6a4f41c89423c21ec9f5b4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:43.868706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.869471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:43.871733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 967/1937] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:43 2022] DELETE /identity/v3/projects/1a3b8bcb6a4f41c89423c21ec9f5b4df => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:43.875534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:43.877083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:43.889953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:43.896736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d4c71-1240-45ee-986a-ecef1a8ec9b9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:43.909644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:43.911360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:43.963102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:43.978711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:43.979753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:43.980151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:43.980525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] PATH_INFO: `/v3/users/b2472c5f260f488194fef45dec2feda7` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:43.981868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2472c5f260f488194fef45dec2feda7)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:43.983909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:43.991902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219938e-7c6c-40a9-bc57-ab4e1ee8fd3e admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:43.998021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:43.998958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:43.999255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:43.999524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] PATH_INFO: `/v3/projects/fe8a99095a0e46279e986049b4bb56a9` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.000884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8a99095a0e46279e986049b4bb56a9)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:44.003050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:44.160898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2472c5f260f488194fef45dec2feda7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.161255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8a99095a0e46279e986049b4bb56a9', 'request_id': 'req-743455cb-9585-43a4-96ad-caada47b9385'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.161705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2472c5f260f488194fef45dec2feda7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.167316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8a99095a0e46279e986049b4bb56a9', 'request_id': 'req-743455cb-9585-43a4-96ad-caada47b9385'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.232453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2472c5f260f488194fef45dec2feda7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.239614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2472c5f260f488194fef45dec2feda7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.251427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e8232fa0-bda7-4fc5-a523-ae5411a3b1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2472c5f260f488194fef45dec2feda7'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.257761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 971/1938] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:43 2022] DELETE /identity/v3/users/b2472c5f260f488194fef45dec2feda7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:44.306846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8a99095a0e46279e986049b4bb56a9', 'request_id': 'req-743455cb-9585-43a4-96ad-caada47b9385'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.320284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] The token cache is being invalidate because project fe8a99095a0e46279e986049b4bb56a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:44.320576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.321302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-743455cb-9585-43a4-96ad-caada47b9385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.323186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 968/1939] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:43 2022] DELETE /identity/v3/projects/fe8a99095a0e46279e986049b4bb56a9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:44.328218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.328504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.328778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.347340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:44.348697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:44.408227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 972/1940] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:44.416444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.416627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.416883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.434255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:44.435528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:44.444443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 969/1941] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:44.451434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:44.463500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62170-4cff-49b1-91ef-0390695aea20 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:44.469413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:44.470250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.470787 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.471213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.472316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:44.472684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:44.474516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:44.487968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 973/1942] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:44.493620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:44.502795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7461c75-d3ac-4957-bf0f-d8e40d3dc7c4 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:44.507351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:44.508040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.508317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.508588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.509395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:44.511336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:44.605381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 970/1943] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:44 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:44.609595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:44.619652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af2e35-d0a7-47a1-bd81-ac4309235dc8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:44.624407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:44.652772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:44.659096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:44.683387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:44.684072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.684360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.684643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.686118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:44.688152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:44.738575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd448e-9dc7-4256-b574-09cab608b15c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:44.743317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:44.744169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.744453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.744726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] PATH_INFO: `/v3/projects/05c0a00bf9e74f49a1efda3fbedf03bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.745906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c0a00bf9e74f49a1efda3fbedf03bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:44.747898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:44.793215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 974/1944] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:44 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:44.794289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:44.796147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:44.850181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:44.852540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5296ecf-f5a2-4ed0-8884-b7ae9c9d33f2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:44.857978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c0a00bf9e74f49a1efda3fbedf03bb', 'request_id': 'req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.864231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c0a00bf9e74f49a1efda3fbedf03bb', 'request_id': 'req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.909079 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:44.909737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.910022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.910300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:44.912249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:44.953234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c0a00bf9e74f49a1efda3fbedf03bb', 'request_id': 'req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.965797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] The token cache is being invalidate because project 05c0a00bf9e74f49a1efda3fbedf03bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:44.966081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.966808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:44.968405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 971/1945] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:44 2022] DELETE /identity/v3/projects/05c0a00bf9e74f49a1efda3fbedf03bb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:44.969516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:44.970986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:44.984219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:44.985755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3dd43-e2d3-475b-943d-415937a6ef14 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:44.996688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 975/1946] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:44.998134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18b99-4184-4a6d-bf36-e72c37c23723 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:44.998618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18b99-4184-4a6d-bf36-e72c37c23723 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:44.998959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18b99-4184-4a6d-bf36-e72c37c23723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.017024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-60e18b99-4184-4a6d-bf36-e72c37c23723 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:45.018292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-60e18b99-4184-4a6d-bf36-e72c37c23723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:45.041152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c4d4-f244-4b6e-9a4c-cb0338784ef3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.046681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.046992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.047352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.047657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.048392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.049983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.064950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 972/1947] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:45.068765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.081643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e303cf-129c-446a-b76b-278b8aa30970 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.083058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 976/1948] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:45.091001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.094214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.094214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.094423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.094535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.094921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.095273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.096533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.098170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.110636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 973/1949] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:45.113557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.115430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:45.116790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:45.124305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313855b-b28d-4d2d-ac4a-b152da370438 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.125680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 977/1950] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:45.130069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879607-d9ce-4cca-9a55-fab60785dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.130247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.131114 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879607-d9ce-4cca-9a55-fab60785dbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.131470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879607-d9ce-4cca-9a55-fab60785dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.131820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879607-d9ce-4cca-9a55-fab60785dbcd admin admin] PATH_INFO: `/v3/projects/9e9c801c31f04a6fb664b6d6304f38f1/users/d26f85c345af424bbd19a1cd99f4708d/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.139916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffba5c3-a59e-417c-b8a2-e5fdd6bd146e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.144844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.145514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.145962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.146069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.147028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:45.147167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.148752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.149683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879607-d9ce-4cca-9a55-fab60785dbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9c801c31f04a6fb664b6d6304f38f1, user_id=d26f85c345af424bbd19a1cd99f4708d, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.152322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879607-d9ce-4cca-9a55-fab60785dbcd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.160607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 978/1951] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:45.172198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.183300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674def6d-adef-4f57-a145-1cb0f48c3efc admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.188861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.189009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.189239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.189522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.190215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.192458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.216875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 974/1952] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:45 2022] PUT /identity/v3/projects/9e9c801c31f04a6fb664b6d6304f38f1/users/d26f85c345af424bbd19a1cd99f4708d/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:45.234175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.234175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.234175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.263869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] MFA Rules not processed for user `d26f85c345af424bbd19a1cd99f4708d`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:45.265150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:45.286303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 979/1953] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:45.293775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.338344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 975/1954] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:45.339287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.355539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37691a64-e7f7-4ef9-950d-9202f16e142e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.360279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.360944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.361230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.361510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.362312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.364267 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.401591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334eda3-1281-4935-bd0b-cd8a363b8cea None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.406189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.406880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.407213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.407521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.408201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.410080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.501732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 980/1955] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:45.505530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.515513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d51db-4f08-4cf8-8670-93360d8e5fda admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.520099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.520738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.521021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.521299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.522028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.524380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.536329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 976/1956] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:45.536490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 981/1957] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:45.537643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.538380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.552640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d157c-dea8-4ecf-939e-977bd65cf993 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.599458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252b724-d581-4e6c-b195-9af8192534a9 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.604265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.604856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.607983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.607983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.607983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.613642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.621380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.622059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.622345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.622657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.623393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.625174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.636395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 982/1958] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:45.637306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.641221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:45.652483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6f1c-d7eb-4ef5-a36a-6a1ef84470b6 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.657151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.658007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.658290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.658564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] PATH_INFO: `/v3/users/a55e2d52e6f54d73ae9a3c17afe59287` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.659821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55e2d52e6f54d73ae9a3c17afe59287)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.664026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.684716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:45.718674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 977/1959] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:45.721718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.729357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf56c-0737-4462-96b8-321f4544cd78 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.734261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.735219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.735503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.735780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] PATH_INFO: `/v3/projects/da4131d689964c7e8ed0933711dbd9d1/users/f9f974f4eee349979f1191d1986d3041/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.741273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:45.753117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4131d689964c7e8ed0933711dbd9d1, user_id=f9f974f4eee349979f1191d1986d3041, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.755849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.831899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 978/1960] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:45 2022] PUT /identity/v3/projects/da4131d689964c7e8ed0933711dbd9d1/users/f9f974f4eee349979f1191d1986d3041/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:45.832932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.869805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55e2d52e6f54d73ae9a3c17afe59287'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:45.870383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55e2d52e6f54d73ae9a3c17afe59287'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:45.894250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c215-6788-4276-af73-98127ae6228b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:45.898885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d89d2-f65e-42c4-be84-ce076ab25921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:45.899538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d89d2-f65e-42c4-be84-ce076ab25921 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.899819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d89d2-f65e-42c4-be84-ce076ab25921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.900094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d89d2-f65e-42c4-be84-ce076ab25921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.900809 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d89d2-f65e-42c4-be84-ce076ab25921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:45.902386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d89d2-f65e-42c4-be84-ce076ab25921 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:45.911922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 979/1961] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:45.913073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda896-1417-4797-96f4-c372ad2e4bbc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:45.916372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda896-1417-4797-96f4-c372ad2e4bbc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:45.916372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda896-1417-4797-96f4-c372ad2e4bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:45.952347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d9cda896-1417-4797-96f4-c372ad2e4bbc None None] MFA Rules not processed for user `f9f974f4eee349979f1191d1986d3041`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:45.953548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d9cda896-1417-4797-96f4-c372ad2e4bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:45.958469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55e2d52e6f54d73ae9a3c17afe59287'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:45.969915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55e2d52e6f54d73ae9a3c17afe59287'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:45.982609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55e2d52e6f54d73ae9a3c17afe59287'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:45.988642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 983/1962] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:45 2022] DELETE /identity/v3/users/a55e2d52e6f54d73ae9a3c17afe59287 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:45.989426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:45.993179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.023807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 980/1963] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:46.025433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.025723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.026158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.044416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:46.045626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.057790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637648e-5e62-4045-aea7-c6d70b63d657 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.062968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.063544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.063828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.064185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] PATH_INFO: `/v3/projects/0840638de1c54e8cb41298c999cc2029/users/0c3a946a52ad41148ea32d28adcf9a44/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.069085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:46.080627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0840638de1c54e8cb41298c999cc2029, user_id=0c3a946a52ad41148ea32d28adcf9a44, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.083408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.104295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 981/1964] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:46.105234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.106572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.167180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba9ac8-2567-4085-8fb7-d30e28f50270 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.171678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.172397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.172682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.173000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.210384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 984/1965] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:45 2022] PUT /identity/v3/projects/0840638de1c54e8cb41298c999cc2029/users/0c3a946a52ad41148ea32d28adcf9a44/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:46.211400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.213077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.235421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.237891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.248427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 982/1966] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:46.249254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.273436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88c80-c001-4047-b29e-352f75bcf8ad service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.279013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:46.288115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c8b2e-4961-46e6-aa6c-3a229c865f7f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.288115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.288292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.288585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.289370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.307144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:46.337256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.338281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.338812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.339355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.340339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.342309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.353920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 983/1967] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:46.355401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.358739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.368615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.370074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.380878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1a81-89b3-49c5-bebd-0bf8bc3080cf admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.382126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 985/1968] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:46.384216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.392091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:46.397820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ce00-bb5a-4591-86b2-2e8eab1c2ff6 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.403468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a473fc7-2a45-44bf-a078-006611aa6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.404732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473fc7-2a45-44bf-a078-006611aa6697 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.405026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473fc7-2a45-44bf-a078-006611aa6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.405309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473fc7-2a45-44bf-a078-006611aa6697 admin admin] PATH_INFO: `/v3/projects/0840638de1c54e8cb41298c999cc2029/users/0c3a946a52ad41148ea32d28adcf9a44/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.407513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a473fc7-2a45-44bf-a078-006611aa6697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0840638de1c54e8cb41298c999cc2029, user_id=0c3a946a52ad41148ea32d28adcf9a44, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.408469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.409548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.409836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.410113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] PATH_INFO: `/v3/users/f9f974f4eee349979f1191d1986d3041` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.411045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a473fc7-2a45-44bf-a078-006611aa6697 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.411349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f974f4eee349979f1191d1986d3041)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.413258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.427798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 986/1969] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:46 2022] PUT /identity/v3/projects/0840638de1c54e8cb41298c999cc2029/users/0c3a946a52ad41148ea32d28adcf9a44/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:46.436606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.437030 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.437424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.474024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] MFA Rules not processed for user `0c3a946a52ad41148ea32d28adcf9a44`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:46.475443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.555188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 987/1970] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:46.566140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.628392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fc166-e298-4ee4-ad56-5c28efc433fe None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.633143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f974f4eee349979f1191d1986d3041'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:46.633495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d9d71-b90f-4999-b332-8a1c35fe08e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.633916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f974f4eee349979f1191d1986d3041'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:46.634129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d9d71-b90f-4999-b332-8a1c35fe08e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.634415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d9d71-b90f-4999-b332-8a1c35fe08e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.634776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d9d71-b90f-4999-b332-8a1c35fe08e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.643226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f974f4eee349979f1191d1986d3041'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:46.646847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d9d71-b90f-4999-b332-8a1c35fe08e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.649324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d9d71-b90f-4999-b332-8a1c35fe08e8 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.654359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:46.666180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 988/1971] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:46.718083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f974f4eee349979f1191d1986d3041'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:46.731720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f974f4eee349979f1191d1986d3041'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:46.738334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 984/1972] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:46 2022] DELETE /identity/v3/users/f9f974f4eee349979f1191d1986d3041 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:46.743273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.743961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.744089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.761267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.762766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.770524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:46.771929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.819703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf873e83-5ac8-48b6-9efb-bde74dd92b7e admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.824054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.824704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.825188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.825394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.829989 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.838619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 989/1973] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:46.839560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.841157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:46.851402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:46.874405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdda7db-c8bd-4733-8da9-39cd404fb3cd None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:46.889441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:46.890631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:46.891135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:46.891337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] PATH_INFO: `/v3/projects/3311b1dbf3e8487fabfde53b6c1e6987` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:46.894355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3311b1dbf3e8487fabfde53b6c1e6987)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.896408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.930204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:46.931676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:46.941728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 985/1974] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:46.942657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:46.944144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:47.003964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b55c8-d879-421b-912c-75b8a194635e service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.019810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3311b1dbf3e8487fabfde53b6c1e6987', 'request_id': 'req-4ea32f9d-14d9-4fd8-9619-e3da44484f97'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.027232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3311b1dbf3e8487fabfde53b6c1e6987', 'request_id': 'req-4ea32f9d-14d9-4fd8-9619-e3da44484f97'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.063626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9919-039f-41cb-8408-a3c2f7275c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.064276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9919-039f-41cb-8408-a3c2f7275c1c service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.064556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9919-039f-41cb-8408-a3c2f7275c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.064836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9919-039f-41cb-8408-a3c2f7275c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.124172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3311b1dbf3e8487fabfde53b6c1e6987', 'request_id': 'req-4ea32f9d-14d9-4fd8-9619-e3da44484f97'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.129076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9919-039f-41cb-8408-a3c2f7275c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.130640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9919-039f-41cb-8408-a3c2f7275c1c service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.137426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] The token cache is being invalidate because project 3311b1dbf3e8487fabfde53b6c1e6987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:47.137761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.138560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4ea32f9d-14d9-4fd8-9619-e3da44484f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.142194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 990/1975] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:46 2022] DELETE /identity/v3/projects/3311b1dbf3e8487fabfde53b6c1e6987 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:47.144237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 986/1976] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:47.147460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.147821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.148716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.170278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:47.171647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:47.180494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 991/1977] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:47.188583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.189051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.189447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.209076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:47.210297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:47.218479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 987/1978] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:47.223194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.233677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4e804-0d71-44b0-8101-21e6fea07c3d None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.243652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.244537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.244930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.245309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.246219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:47.246617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.248407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.265086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 992/1979] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:47.269536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.279149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f163e0-a828-4b8c-af5f-747c12e845ce None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.284072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.284756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.285059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.285334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.286032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.287993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.299878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:47.434229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 988/1980] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:47 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:47.435451 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.446201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be942a-e37e-4424-b961-079849ea8ea1 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.539759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.540480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.540767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.541075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.541767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.543723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.553682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:47.630273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 993/1981] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:47 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:47.634808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.635487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.637559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:47.655551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a355-b699-46ad-99e8-75d442e97cd0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.673503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.674405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.675019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.675413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.676328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.678578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.692580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 994/1982] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:47.699103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.700212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b566e3-a9ba-406a-99b1-96db3f52a4c1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.706432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.706432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.706895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.707805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] PATH_INFO: `/v3/projects/da4131d689964c7e8ed0933711dbd9d1` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.708661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4131d689964c7e8ed0933711dbd9d1)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.711031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.711377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33b4c-aed6-46ee-99e0-5d5514217b06 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.717865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.718543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.719015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.719416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.720748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.725261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.741746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 995/1983] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:47.743047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.755983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de45bc-5e9d-46ab-8d6c-6b189122cd55 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:47.760887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2ebd-828c-498d-9d94-93ce75ed55d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:47.761918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2ebd-828c-498d-9d94-93ce75ed55d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.762197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2ebd-828c-498d-9d94-93ce75ed55d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.762469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2ebd-828c-498d-9d94-93ce75ed55d2 admin admin] PATH_INFO: `/v3/projects/0b2b642fa7074cedbec7fe7368fe6f70/users/f55be221ebb54f97b118f20554b61600/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.778304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2ebd-828c-498d-9d94-93ce75ed55d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2b642fa7074cedbec7fe7368fe6f70, user_id=f55be221ebb54f97b118f20554b61600, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:47.781037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2ebd-828c-498d-9d94-93ce75ed55d2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:47.845980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 996/1984] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:47 2022] PUT /identity/v3/projects/0b2b642fa7074cedbec7fe7368fe6f70/users/f55be221ebb54f97b118f20554b61600/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:47.859065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4131d689964c7e8ed0933711dbd9d1', 'request_id': 'req-489a484c-eca2-4c61-b0d1-2461350fe6de'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.861077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.861376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.861753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.864174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4131d689964c7e8ed0933711dbd9d1', 'request_id': 'req-489a484c-eca2-4c61-b0d1-2461350fe6de'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.891522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] MFA Rules not processed for user `f55be221ebb54f97b118f20554b61600`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:47.892748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:47.912712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4131d689964c7e8ed0933711dbd9d1', 'request_id': 'req-489a484c-eca2-4c61-b0d1-2461350fe6de'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.927104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] The token cache is being invalidate because project da4131d689964c7e8ed0933711dbd9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:47.927104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.927382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-489a484c-eca2-4c61-b0d1-2461350fe6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:47.929020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 989/1985] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:47 2022] DELETE /identity/v3/projects/da4131d689964c7e8ed0933711dbd9d1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:47.934344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d7f0-c71c-47c0-836e-85226ea17437 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:47.934649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d7f0-c71c-47c0-836e-85226ea17437 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:47.934950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d7f0-c71c-47c0-836e-85226ea17437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:47.954683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2cf0d7f0-c71c-47c0-836e-85226ea17437 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:47.955911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2cf0d7f0-c71c-47c0-836e-85226ea17437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:47.976622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 997/1986] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:47.984089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:47.985523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:48.042890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 990/1987] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:48.044599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.044599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.044861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.047662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d091-e8fa-4ab1-8ae8-c2dc5f893cd0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.061457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.062574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.062915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.063289 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.064937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:48.066217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:48.075732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.076285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 991/1988] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:48.077353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.083247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.087417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 998/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:48.095282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233244-42e9-4b5a-a536-7014f0c86dfc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.101432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.103076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.103647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.103844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.104654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:48.105065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.107255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.119895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 992/1990] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:48.124677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.136044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49fe44-07a9-4ee5-b753-d8613e9397bb service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.140747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.141398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.141676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.141951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.142661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.144636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.262761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 999/1991] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:48 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:48.266769 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.276582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ac806-65fd-468b-8ae9-413db2a1f1e1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.331321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:48.338396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.339104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.339690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.339690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.340355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.342294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.441416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 993/1992] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:48 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:48.442700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.453483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c22b7b-069c-4691-af41-2e20ecb958bc admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.458207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.458906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.459193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.459507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.460231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.461864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.473016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1000/1993] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:48.477415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.487409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c037-5d59-4dc6-bf9b-e067aa5144e2 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.492777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba2068-9b07-448f-9bd0-aebf54ec8174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.493471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba2068-9b07-448f-9bd0-aebf54ec8174 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.493713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba2068-9b07-448f-9bd0-aebf54ec8174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.498320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba2068-9b07-448f-9bd0-aebf54ec8174 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.498320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba2068-9b07-448f-9bd0-aebf54ec8174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.498320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba2068-9b07-448f-9bd0-aebf54ec8174 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.507325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 994/1994] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:48.511336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.518246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:48.522026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd15ff5-429d-4855-9968-b7de2658b1b9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.526749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.527620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.527896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.528166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] PATH_INFO: `/v3/projects/af84fb62c36d4f849061e846c86643d6/users/55bb688107034191becad19c37873d41/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.542781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af84fb62c36d4f849061e846c86643d6, user_id=55bb688107034191becad19c37873d41, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.545405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.592277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1001/1995] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:48 2022] PUT /identity/v3/projects/af84fb62c36d4f849061e846c86643d6/users/55bb688107034191becad19c37873d41/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:48.603772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.604082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.604365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.630556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] MFA Rules not processed for user `55bb688107034191becad19c37873d41`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:48.631783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:48.698802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 995/1996] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:48.722328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:48.724290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:48.808789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e287b-3c61-46be-a3ee-368909523c31 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:48.812539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d2cd-0edd-4ba5-9f5a-f67488c6e39c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:48.813377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d2cd-0edd-4ba5-9f5a-f67488c6e39c service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:48.813513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d2cd-0edd-4ba5-9f5a-f67488c6e39c service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:48.813790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d2cd-0edd-4ba5-9f5a-f67488c6e39c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:48.824901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d2cd-0edd-4ba5-9f5a-f67488c6e39c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:48.824901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d2cd-0edd-4ba5-9f5a-f67488c6e39c service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:48.833901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1002/1997] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:49.556796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:49.558336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:49.627204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479035-5af8-45b0-8bbb-03b5100b9b73 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:49.631765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:49.633301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:49.633585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:49.633858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] PATH_INFO: `/v3/users/f75659e538e344fcb81f2a14d2f20bd3` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:49.635135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75659e538e344fcb81f2a14d2f20bd3)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:49.637061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:49.846189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75659e538e344fcb81f2a14d2f20bd3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:49.847149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75659e538e344fcb81f2a14d2f20bd3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:49.854552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75659e538e344fcb81f2a14d2f20bd3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:49.941335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75659e538e344fcb81f2a14d2f20bd3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:49.944162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:49.955278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75659e538e344fcb81f2a14d2f20bd3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:49.961229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 996/1998] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:49 2022] DELETE /identity/v3/users/f75659e538e344fcb81f2a14d2f20bd3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:49.967069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:49.967550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:49.967668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:49.985233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:49.986458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:50.050322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1003/1999] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:50.061154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:50.062023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:50.118738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8b20-186c-4045-8f28-941821aaa2d7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:50.122282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a644c-2f61-49ee-a491-880c65445922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:50.123029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a644c-2f61-49ee-a491-880c65445922 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:50.123256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a644c-2f61-49ee-a491-880c65445922 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:50.123533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a644c-2f61-49ee-a491-880c65445922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:50.132575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a644c-2f61-49ee-a491-880c65445922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:50.134001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a644c-2f61-49ee-a491-880c65445922 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:50.144080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 997/2000] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:50.519420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:50.520956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:50.534883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bb5ad-45fb-4885-8dd5-cdf848a24a76 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:50.540634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:50.541505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:50.541784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:50.542061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] PATH_INFO: `/v3/projects/4e02a419d4e243b699ea8091247fb83f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:50.553358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e02a419d4e243b699ea8091247fb83f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:50.555358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:50.601819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:50.602348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:50.602465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:50.619806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] MFA Rules not processed for user `55bb688107034191becad19c37873d41`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:50.621029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:50.676215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e02a419d4e243b699ea8091247fb83f', 'request_id': 'req-904b49d9-284a-4caf-856a-7f108cd786d4'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:50.685821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e02a419d4e243b699ea8091247fb83f', 'request_id': 'req-904b49d9-284a-4caf-856a-7f108cd786d4'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:50.696340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 998/2001] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:50.769579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e02a419d4e243b699ea8091247fb83f', 'request_id': 'req-904b49d9-284a-4caf-856a-7f108cd786d4'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:50.782299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] The token cache is being invalidate because project 4e02a419d4e243b699ea8091247fb83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:50.782605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:50.783262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:50.784816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1004/2002] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:50 2022] DELETE /identity/v3/projects/4e02a419d4e243b699ea8091247fb83f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:50.788914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:50.799568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22fa43-d9ea-4833-8591-15fac277fc10 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:50.873768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:50.874686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:50.874971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:50.875248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] PATH_INFO: `/v3/users/a029f8b16e0b45b9a43993e96c5c955f` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:50.876462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a029f8b16e0b45b9a43993e96c5c955f)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:50.878814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:51.057693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:51.073561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a029f8b16e0b45b9a43993e96c5c955f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.074480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a029f8b16e0b45b9a43993e96c5c955f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.098687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a029f8b16e0b45b9a43993e96c5c955f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.192515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a029f8b16e0b45b9a43993e96c5c955f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.211050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a029f8b16e0b45b9a43993e96c5c955f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.217596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 999/2003] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:50 2022] DELETE /identity/v3/users/a029f8b16e0b45b9a43993e96c5c955f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:51.664574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:51.666604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:51.689620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b49d9-284a-4caf-856a-7f108cd786d4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:51.693184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:51.755323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:51.756502 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:51.756881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:51.757219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] PATH_INFO: `/v3/projects/56bd5f0ebcbc4f2381e6b138ba06439c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:51.758642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bd5f0ebcbc4f2381e6b138ba06439c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:51.760697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:51.870146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bd5f0ebcbc4f2381e6b138ba06439c', 'request_id': 'req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.875560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bd5f0ebcbc4f2381e6b138ba06439c', 'request_id': 'req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:51.877422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:51.878884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:52.208744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec6e54-f0ac-4456-a3d5-b11e4a076e9c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.208744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.208744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.208744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.209725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] PATH_INFO: `/v3/users/d26f85c345af424bbd19a1cd99f4708d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.209725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26f85c345af424bbd19a1cd99f4708d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.209725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.210303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bd5f0ebcbc4f2381e6b138ba06439c', 'request_id': 'req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.224227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] The token cache is being invalidate because project 56bd5f0ebcbc4f2381e6b138ba06439c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:52.224523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.225208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0dcdd2e0-59d3-40fb-9133-7ac621f9c321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.227768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1005/2004] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:51 2022] DELETE /identity/v3/projects/56bd5f0ebcbc4f2381e6b138ba06439c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:52.232763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec36b-c5d9-490c-815f-39a41f5a5339 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.233098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec36b-c5d9-490c-815f-39a41f5a5339 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.233452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec36b-c5d9-490c-815f-39a41f5a5339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.253272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b19ec36b-c5d9-490c-815f-39a41f5a5339 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:52.254518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b19ec36b-c5d9-490c-815f-39a41f5a5339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:52.262839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1006/2005] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:52.270558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.270891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.271156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.289495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:52.290717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:52.298877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1007/2006] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:52.302964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.312641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d73a4-31b6-4df0-984b-f6cc249e1159 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.317470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.322623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.322623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.322623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.322623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:52.322623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.322623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.333580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1008/2007] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:57:52.337719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.355201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f94f2-39ce-4f5a-a160-6756c4b87964 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.360791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.361513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.361896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.362205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.363813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.365363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.371778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26f85c345af424bbd19a1cd99f4708d'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.372474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26f85c345af424bbd19a1cd99f4708d'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.381563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26f85c345af424bbd19a1cd99f4708d'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.451583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1009/2008] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:52 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:52.455431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.461501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26f85c345af424bbd19a1cd99f4708d'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.480536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd5df774-214d-4f2f-8a1e-784b0f344fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26f85c345af424bbd19a1cd99f4708d'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:52.487324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1000/2009] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:51 2022] DELETE /identity/v3/users/d26f85c345af424bbd19a1cd99f4708d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:52.491529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.491910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.492189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.516704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:52.517938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:52.523947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:52.545702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:52.547019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979bf6e-587f-4295-8c7a-6525cf5640fc admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.589814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1001/2010] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:52.595912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.597667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:52.624920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.626140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.626140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.626325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.626904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.628868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.666753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fc6b4-6b28-40e4-bb8e-403fefa833cd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.668873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.669522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.669804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.670217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.689721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.693445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.709864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1010/2011] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:52 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:52.712294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.712985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1002/2012] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:52.715607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:52.727994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4c4e-1543-4bba-8428-cfb46d80e7f2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.732744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.733683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.733969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.734357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.735120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.736703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.747554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1011/2013] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:52.751545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.762064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d96c3-586a-45cf-aca4-8daa41191584 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.766922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dd5e-eb0d-4f13-9814-5cc551db0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.767595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dd5e-eb0d-4f13-9814-5cc551db0ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.767875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dd5e-eb0d-4f13-9814-5cc551db0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.768168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dd5e-eb0d-4f13-9814-5cc551db0ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.768869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dd5e-eb0d-4f13-9814-5cc551db0ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.770454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dd5e-eb0d-4f13-9814-5cc551db0ef0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.781468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1003/2014] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:52.786276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:52.796856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc22fab-228c-4877-834e-6580c49b3509 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:52.802662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:52.803677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.804036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.804424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] PATH_INFO: `/v3/projects/dcbf70d50a4c4b0495236996af8d1e00/users/fb1631c572044a80971d2bb7015f2827/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.822265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbf70d50a4c4b0495236996af8d1e00, user_id=fb1631c572044a80971d2bb7015f2827, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:52.825066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:52.895752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1012/2015] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:52 2022] PUT /identity/v3/projects/dcbf70d50a4c4b0495236996af8d1e00/users/fb1631c572044a80971d2bb7015f2827/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:52.907358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:52.907890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:52.908053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:52.934953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] MFA Rules not processed for user `fb1631c572044a80971d2bb7015f2827`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:52.936619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:53.030512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1004/2016] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:53.035035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.097381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729dea7-7cac-4934-aa6a-6f823d2a5f99 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.102180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.102875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.103158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.103537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.104272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.106463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.222090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.222090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:53.234166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7adf88-dab5-42d3-aa40-95a162e4b541 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.241507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.243285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.243623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.244026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] PATH_INFO: `/v3/projects/9e9c801c31f04a6fb664b6d6304f38f1` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.245284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9c801c31f04a6fb664b6d6304f38f1)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.246895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1013/2017] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:53 2022] POST /identity/v3/projects => generated 389 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:53.250646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.253180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.294172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:53.318330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae985f-fac2-47c6-99f8-27ff3ca595f9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.323928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.324606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.324889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.325167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.325859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.327862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.369521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9c801c31f04a6fb664b6d6304f38f1', 'request_id': 'req-9b481055-8ed2-45a9-901c-16d24623adc7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.374845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9c801c31f04a6fb664b6d6304f38f1', 'request_id': 'req-9b481055-8ed2-45a9-901c-16d24623adc7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.415658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1014/2018] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:53 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:53.419416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.428915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5b7d-281e-475d-8c9e-72df5df898c8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.467611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9c801c31f04a6fb664b6d6304f38f1', 'request_id': 'req-9b481055-8ed2-45a9-901c-16d24623adc7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.470609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:53.481510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] The token cache is being invalidate because project 9e9c801c31f04a6fb664b6d6304f38f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:53.481661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.482255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.483827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1005/2019] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:53 2022] DELETE /identity/v3/projects/9e9c801c31f04a6fb664b6d6304f38f1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:53.484243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.484941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.485227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.485507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.486271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.487706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.487911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.489480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:53.498547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1015/2020] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:53.505279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481055-8ed2-45a9-901c-16d24623adc7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.508764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.509073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.509996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.510257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.510530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:53.511018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] PATH_INFO: `/v3/users/0c3a946a52ad41148ea32d28adcf9a44` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.512268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3a946a52ad41148ea32d28adcf9a44)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.514229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.523021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f47e3f-1fe5-4097-bc67-7c26c509a66b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.527857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.529854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.529854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.529854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] PATH_INFO: `/v3/projects/960678e10e114a869e639d612852d7d6/users/6862045cc28f4d80b587750f97296d16/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.545169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960678e10e114a869e639d612852d7d6, user_id=6862045cc28f4d80b587750f97296d16, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.547925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.611342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1016/2021] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:53 2022] PUT /identity/v3/projects/960678e10e114a869e639d612852d7d6/users/6862045cc28f4d80b587750f97296d16/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:53.615258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.658065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3a946a52ad41148ea32d28adcf9a44'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.659293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3a946a52ad41148ea32d28adcf9a44'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.669747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3a946a52ad41148ea32d28adcf9a44'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.687226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24769f-977e-4b5a-868e-6832b3a87d31 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.695826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.697263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.697263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.697263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.698205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.699893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.714118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1017/2022] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:53.718177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.729090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3a946a52ad41148ea32d28adcf9a44'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.730295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187a21-7f05-4fb8-942e-aee43326df46 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.738014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.738954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.739240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.739522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] PATH_INFO: `/v3/projects/960678e10e114a869e639d612852d7d6/users/6862045cc28f4d80b587750f97296d16/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.741573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960678e10e114a869e639d612852d7d6, user_id=6862045cc28f4d80b587750f97296d16, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:53.744838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:53.747238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f2cee404-2fba-475f-b7a7-73dda33d5943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3a946a52ad41148ea32d28adcf9a44'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:53.753541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1006/2023] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:53 2022] DELETE /identity/v3/users/0c3a946a52ad41148ea32d28adcf9a44 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:53.756073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1018/2024] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:53 2022] PUT /identity/v3/projects/960678e10e114a869e639d612852d7d6/users/6862045cc28f4d80b587750f97296d16/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:53.766613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.767010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.767521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:53.796393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] MFA Rules not processed for user `6862045cc28f4d80b587750f97296d16`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:53.797788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:53.876660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1007/2025] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:53.887781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:53.889661 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:53.936636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:53.946934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233531c4-7259-476c-8407-9ef086175567 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:53.995619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:53.995619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:53.995941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:53.996039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.010397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:54.011957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:54.027182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1019/2026] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:54.169800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:54.171273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:54.204792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:54.235536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0737-db24-45c3-9ae8-89aa7144a43e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:54.240237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:54.241102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.241382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.241653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] PATH_INFO: `/v3/users/fb1631c572044a80971d2bb7015f2827` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.242950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1631c572044a80971d2bb7015f2827)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:54.244865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:54.268443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:54.270075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:54.289778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a736-2f94-400a-bbbf-65840554503e service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:54.296443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:54.296443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.296443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.296443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] PATH_INFO: `/v3/projects/0840638de1c54e8cb41298c999cc2029` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.297853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0840638de1c54e8cb41298c999cc2029)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:54.299311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:54.493163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0840638de1c54e8cb41298c999cc2029', 'request_id': 'req-1326d677-89d1-4e05-9b8a-d8aafdd521b3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.493675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1631c572044a80971d2bb7015f2827'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.495052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1631c572044a80971d2bb7015f2827'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.500749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0840638de1c54e8cb41298c999cc2029', 'request_id': 'req-1326d677-89d1-4e05-9b8a-d8aafdd521b3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.503683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1631c572044a80971d2bb7015f2827'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.571061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0840638de1c54e8cb41298c999cc2029', 'request_id': 'req-1326d677-89d1-4e05-9b8a-d8aafdd521b3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.583915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] The token cache is being invalidate because project 0840638de1c54e8cb41298c999cc2029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:54.584207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.584856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-1326d677-89d1-4e05-9b8a-d8aafdd521b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.587026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1020/2027] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:54 2022] DELETE /identity/v3/projects/0840638de1c54e8cb41298c999cc2029 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:54.591728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086872e-b71b-45e1-8b27-3a2913f28269 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.592020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086872e-b71b-45e1-8b27-3a2913f28269 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.592329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086872e-b71b-45e1-8b27-3a2913f28269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.610367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f086872e-b71b-45e1-8b27-3a2913f28269 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:54.611714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f086872e-b71b-45e1-8b27-3a2913f28269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:54.659092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1631c572044a80971d2bb7015f2827'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.676595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e904dee5-6ea6-4af2-a7fd-19855750afa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1631c572044a80971d2bb7015f2827'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:54.680896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1021/2028] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:54.684176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1008/2029] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:54 2022] DELETE /identity/v3/users/fb1631c572044a80971d2bb7015f2827 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:54.689200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.692202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.692202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.692435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.692525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.692629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.708918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:54.709131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:54.710145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:54.710294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:54.730853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:54.778128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1022/2030] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:54.787012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1009/2031] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:54.788105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:54.788693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:54.790307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:54.820658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc89c7-edb1-460f-96cf-9e3034635b78 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:54.833230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:54.837678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.837678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.837678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.837678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:54.837678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:54.838440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:54.855295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1023/2032] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:57:54.859588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:54.873557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66702d13-cab3-4607-b888-e46f9ab16030 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:54.880229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:54.883380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.883380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.883380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.883380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:54.887756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:54.893315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4f0-3e33-42ee-a0ee-b5b84af9640e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:54.898642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:54.899550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:54.900613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:54.900959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:54.917548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:54.919202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:54.934726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1010/2033] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:54.962615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1024/2034] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:54.966679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:54.983370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abbaf-b8e8-4db9-9ca5-ae4dd3501094 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.063164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.063932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.064213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.064487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.065175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.067176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.132795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1011/2035] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:54 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:55.136850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.147230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6393ab-bddc-4f96-9b07-e2654a30cf40 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.152014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.152784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.153134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.153511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.154309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.156028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.167581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1025/2036] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:55.174365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.185491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bc80c-64bf-4efa-baaf-8b5a38ae9be6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.190403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d311c79-ccd1-4212-9ad7-3ada6cfc6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.191147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311c79-ccd1-4212-9ad7-3ada6cfc6574 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.191429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311c79-ccd1-4212-9ad7-3ada6cfc6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.191732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311c79-ccd1-4212-9ad7-3ada6cfc6574 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.192465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311c79-ccd1-4212-9ad7-3ada6cfc6574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.194097 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311c79-ccd1-4212-9ad7-3ada6cfc6574 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.205668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1012/2037] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:55.210242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.216147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:55.221203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf30c3-bbfc-4674-9b6d-2d97836a30f6 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.226914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.227824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.228103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.228402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] PATH_INFO: `/v3/projects/ca8c2049e516484989c31985a271e00b/users/7180e8eabead4a749d3ca307b7bd6c94/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.244950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8c2049e516484989c31985a271e00b, user_id=7180e8eabead4a749d3ca307b7bd6c94, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.247684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.290826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1026/2038] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:55 2022] PUT /identity/v3/projects/ca8c2049e516484989c31985a271e00b/users/7180e8eabead4a749d3ca307b7bd6c94/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:55.308482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.308789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.309071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.338475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] MFA Rules not processed for user `7180e8eabead4a749d3ca307b7bd6c94`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:55.339652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:55.405167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.405464 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:55.410191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1013/2039] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:55.415321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.484441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1f803-316c-473f-b30e-870d19164d99 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.487550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d083b9-6cab-4d12-8af4-dc6eb374a9b8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.489500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.490674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.490938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.491290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.492235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.493212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.494202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.494312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.494389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.494660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] PATH_INFO: `/v3/users/f55be221ebb54f97b118f20554b61600` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.495854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55be221ebb54f97b118f20554b61600)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.500559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.500685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:55.602116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1014/2040] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:55 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:55.606442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.672064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6626e6-ff29-496f-8888-449e8fa8808d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.676801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.677788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.678071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.678350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.679070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.681516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.698758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:55.712400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55be221ebb54f97b118f20554b61600'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:55.713459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55be221ebb54f97b118f20554b61600'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:55.797045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1015/2041] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:55 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:55.797045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.797045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:55.798026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c3a3f-467c-4f92-bf66-ee73bbfda670 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.799264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55be221ebb54f97b118f20554b61600'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:55.802524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.803601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.804322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] PATH_INFO: `/v3/projects/dcbf70d50a4c4b0495236996af8d1e00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.805925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbf70d50a4c4b0495236996af8d1e00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.807940 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.810060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55be221ebb54f97b118f20554b61600'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:55.835470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55be221ebb54f97b118f20554b61600'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:55.842739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1027/2042] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:55 2022] DELETE /identity/v3/users/f55be221ebb54f97b118f20554b61600 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:55.847124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:55.848611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:55.921788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28503a05-0f95-4740-81ca-393216586cfd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:55.926842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e1a4-f6cb-4e7d-be79-d6364282939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:55.927539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e1a4-f6cb-4e7d-be79-d6364282939b admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.927970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e1a4-f6cb-4e7d-be79-d6364282939b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.928257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e1a4-f6cb-4e7d-be79-d6364282939b admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.928998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85e1a4-f6cb-4e7d-be79-d6364282939b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:55.931225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85e1a4-f6cb-4e7d-be79-d6364282939b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:55.944710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1028/2043] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:55.946333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:55.946653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:55.946939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:55.964335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbf70d50a4c4b0495236996af8d1e00', 'request_id': 'req-3171c487-7ce1-40ad-90bc-cc6a69071747'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:55.965017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:55.966243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:55.972546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbf70d50a4c4b0495236996af8d1e00', 'request_id': 'req-3171c487-7ce1-40ad-90bc-cc6a69071747'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.026876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbf70d50a4c4b0495236996af8d1e00', 'request_id': 'req-3171c487-7ce1-40ad-90bc-cc6a69071747'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.036898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1029/2044] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:56.039286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.042188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] The token cache is being invalidate because project dcbf70d50a4c4b0495236996af8d1e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:56.042633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.043477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.046227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1016/2045] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:55 2022] DELETE /identity/v3/projects/dcbf70d50a4c4b0495236996af8d1e00 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:56.047182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.048650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.055176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999946f-d062-4023-bb59-dbe2a71c614e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.073820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.075445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.075594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.075842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] PATH_INFO: `/v3/projects/59f451bb4e7044a7a30f37a5d8ce6847/users/bf89475883d74c90ab64ab25869027e8/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.098776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f451bb4e7044a7a30f37a5d8ce6847, user_id=bf89475883d74c90ab64ab25869027e8, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:56.104207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:56.130781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171c487-7ce1-40ad-90bc-cc6a69071747 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.140495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.141259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.141544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.141816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.146834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.168799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:56.170268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:56.184867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1017/2046] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:56.186983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.188553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.196467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:56.202356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a094e-0559-4cf3-b1e2-990285c30282 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.208275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.209475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.209966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.211146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] PATH_INFO: `/v3/users/6862045cc28f4d80b587750f97296d16` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.212819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6862045cc28f4d80b587750f97296d16)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:56.215616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:56.241612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1030/2047] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:56 2022] PUT /identity/v3/projects/59f451bb4e7044a7a30f37a5d8ce6847/users/bf89475883d74c90ab64ab25869027e8/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:56.243761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.247196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.279454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:56.320899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ddaff-e244-4fa4-9047-7c49a8b43614 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.327273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.328280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.328677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.329176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.329862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:56.331831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:56.345070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1031/2048] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:56.355711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.365909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2cd99-8899-48bb-bc1d-8555e193e666 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.371853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca39564-438c-41ac-857e-2593fbb6a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.372889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39564-438c-41ac-857e-2593fbb6a505 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.373184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39564-438c-41ac-857e-2593fbb6a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.373472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39564-438c-41ac-857e-2593fbb6a505 admin admin] PATH_INFO: `/v3/projects/59f451bb4e7044a7a30f37a5d8ce6847/users/bf89475883d74c90ab64ab25869027e8/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.375748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca39564-438c-41ac-857e-2593fbb6a505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f451bb4e7044a7a30f37a5d8ce6847, user_id=bf89475883d74c90ab64ab25869027e8, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:56.387201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca39564-438c-41ac-857e-2593fbb6a505 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:56.389759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1032/2049] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:56 2022] PUT /identity/v3/projects/59f451bb4e7044a7a30f37a5d8ce6847/users/bf89475883d74c90ab64ab25869027e8/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:56.400272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.400593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.400859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.428962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] MFA Rules not processed for user `bf89475883d74c90ab64ab25869027e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:56.430252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.430741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6862045cc28f4d80b587750f97296d16'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.431451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6862045cc28f4d80b587750f97296d16'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.439954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6862045cc28f4d80b587750f97296d16'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.491487 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6862045cc28f4d80b587750f97296d16'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.517513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1033/2050] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:56.522015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6862045cc28f4d80b587750f97296d16'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:56.527952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.535179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.544005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1018/2051] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:57:56 2022] DELETE /identity/v3/users/6862045cc28f4d80b587750f97296d16 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:56.616736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a738-07db-4562-9c39-4bd2b869ec70 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.701720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.702766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.702945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.703423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.705644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.714988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:56.779047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:56.780606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:56.799117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1034/2052] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:56.904113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.905565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.917866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf52668-aaca-4363-a389-ca421a74ad4a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:56.921658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:56.922385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:56.922704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:56.922980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:56.924726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:56.930028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:56.934108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:57.042534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58caa-0ca4-4603-a12b-a82e463b8245 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.044439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.046264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.054843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.056705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.057019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.057297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] PATH_INFO: `/v3/projects/0b2b642fa7074cedbec7fe7368fe6f70` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.066866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2b642fa7074cedbec7fe7368fe6f70)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.068148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1019/2053] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:57.069793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.113948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.115689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:57.143331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468af8-eb86-4c25-b862-412e69ec01db service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.149802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.152802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.153096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.153379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] PATH_INFO: `/v3/projects/960678e10e114a869e639d612852d7d6` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.155033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960678e10e114a869e639d612852d7d6)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.156994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.216773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2b642fa7074cedbec7fe7368fe6f70', 'request_id': 'req-466f0774-e236-4d96-860b-5f0fd7af5c5b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.230159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2b642fa7074cedbec7fe7368fe6f70', 'request_id': 'req-466f0774-e236-4d96-860b-5f0fd7af5c5b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.309876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960678e10e114a869e639d612852d7d6', 'request_id': 'req-157f59bb-1c1c-4cce-b30d-5878bbae19a3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.313191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2b642fa7074cedbec7fe7368fe6f70', 'request_id': 'req-466f0774-e236-4d96-860b-5f0fd7af5c5b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.318703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960678e10e114a869e639d612852d7d6', 'request_id': 'req-157f59bb-1c1c-4cce-b30d-5878bbae19a3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.330911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] The token cache is being invalidate because project 0b2b642fa7074cedbec7fe7368fe6f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:57.331325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.332202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-466f0774-e236-4d96-860b-5f0fd7af5c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.338536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1035/2054] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:56 2022] DELETE /identity/v3/projects/0b2b642fa7074cedbec7fe7368fe6f70 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:57.340791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a1ff-2b40-4d70-9c7e-33bce6f67d0f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.341394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a1ff-2b40-4d70-9c7e-33bce6f67d0f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.341679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9a1ff-2b40-4d70-9c7e-33bce6f67d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.361747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-33d9a1ff-2b40-4d70-9c7e-33bce6f67d0f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:57.363025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-33d9a1ff-2b40-4d70-9c7e-33bce6f67d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:57.371252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960678e10e114a869e639d612852d7d6', 'request_id': 'req-157f59bb-1c1c-4cce-b30d-5878bbae19a3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.373908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:57.388887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] The token cache is being invalidate because project 960678e10e114a869e639d612852d7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:57:57.389173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.390219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-157f59bb-1c1c-4cce-b30d-5878bbae19a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:57:57.391931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1020/2055] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:57:57 2022] DELETE /identity/v3/projects/960678e10e114a869e639d612852d7d6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:57.398027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43706-810e-45fb-9701-51482603f877 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.398661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43706-810e-45fb-9701-51482603f877 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.399984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:57.400335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43706-810e-45fb-9701-51482603f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.430391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-61a43706-810e-45fb-9701-51482603f877 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:57.432262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-61a43706-810e-45fb-9701-51482603f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:57.475034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1036/2056] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:57.484360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.484573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.484918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.510404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:57.511805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:57.521226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1037/2057] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:57.522391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1021/2058] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:57.530685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.533822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.534297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.535453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.543783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9f6ce-344c-4c4d-b87d-bba2edcd0339 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.551000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.551778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.552318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.552671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.553549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:57.553969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.557007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.571476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:57.572688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1038/2059] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:57.573018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:57.579313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.582816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1022/2060] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:57.587142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.593265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a236b-079d-46ac-a195-310ac3900a9f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.598258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569970-34dc-437f-8f6a-4dde05d7db43 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.599067 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.599845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.600215 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.600605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.602382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.604467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.604672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.605345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.605632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.605910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.606728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:57:57.607638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.609253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.630092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1023/2061] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:57:57.631314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.644175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dc903-a1d4-4006-82da-2df2b8b603a5 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.650826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.651736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.652100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.652452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.653260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.655415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.719155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1039/2062] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:57.722410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.793639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26721-f266-4162-8350-9f8b2078086b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.796143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1024/2063] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/projects => generated 407 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:57.806003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.856444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.857125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.857407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.857683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.858383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.860345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.890286 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ebca-e9ee-4cb7-8ce7-6a6effb27446 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.896113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.900970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.900970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.900970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.900970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.902539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.920770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1040/2064] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:57.925110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.936238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7387e-5dba-4187-8157-be45912c8a3c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.941211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.942019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.942283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.942624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.943394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.945235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.955462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1041/2065] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:57.959388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.969784 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f5400-9635-463b-89e1-78d216a29d7c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.974896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.975568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.975858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.975976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1025/2066] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:57 2022] POST /identity/v3/users => generated 304 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:57.976865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.977701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.979405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:57.980532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:57.990977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b76c-022d-4156-bdbd-182dee3e220a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:57.995896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:57.998005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:57.998005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:57.998329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1042/2067] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:57.998423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:57.998423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:57.999508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.001093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.006494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:58.010625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1026/2068] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:58.012007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05763-65e0-4f35-b7ca-9e6e3b2e06ed admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.016830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9414b-c5d5-4736-bbfd-dbfe8e48f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.022840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9414b-c5d5-4736-bbfd-dbfe8e48f62c admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.022840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9414b-c5d5-4736-bbfd-dbfe8e48f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.022840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9414b-c5d5-4736-bbfd-dbfe8e48f62c admin admin] PATH_INFO: `/v3/projects/18a734e39a6940b1b75c60b079750074/users/c4240da6bcca4522b9928f04e045934a/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.026281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.034400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9414b-c5d5-4736-bbfd-dbfe8e48f62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a734e39a6940b1b75c60b079750074, user_id=c4240da6bcca4522b9928f04e045934a, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.038099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb18f-f62d-4cf3-8ef5-9596c92c8611 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.038351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9414b-c5d5-4736-bbfd-dbfe8e48f62c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.043423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.044073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.044400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.044677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.045396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.047025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.058314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1027/2069] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:57:58.062741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.072980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e6a1-2c4d-4872-8e0e-85adf96753ec admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.077854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc938f-bdf9-4bf8-be2b-ea546c3c80bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.078766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc938f-bdf9-4bf8-be2b-ea546c3c80bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.079056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc938f-bdf9-4bf8-be2b-ea546c3c80bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.079334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc938f-bdf9-4bf8-be2b-ea546c3c80bf admin admin] PATH_INFO: `/v3/projects/68b5283ad5c34d9ebf7dff99eb7a4435/users/2b5a3ca095c240359f088f94f77f3717/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.096192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc938f-bdf9-4bf8-be2b-ea546c3c80bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b5283ad5c34d9ebf7dff99eb7a4435, user_id=2b5a3ca095c240359f088f94f77f3717, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.099175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc938f-bdf9-4bf8-be2b-ea546c3c80bf admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.107195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1043/2070] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:58 2022] PUT /identity/v3/projects/18a734e39a6940b1b75c60b079750074/users/c4240da6bcca4522b9928f04e045934a/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:58.117112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.117400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.117705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.143383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] MFA Rules not processed for user `c4240da6bcca4522b9928f04e045934a`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:58.144615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:58.147564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:58.154023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1028/2071] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:58 2022] PUT /identity/v3/projects/68b5283ad5c34d9ebf7dff99eb7a4435/users/2b5a3ca095c240359f088f94f77f3717/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:58.164236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.164526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.164802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.191798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] MFA Rules not processed for user `2b5a3ca095c240359f088f94f77f3717`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:58.194405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:58.216055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1044/2072] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:58.227531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.228916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:58.261334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1029/2073] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:57:58.265795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.286018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25711c8-149e-4182-a157-9ddfbb3f3ce3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.332028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1209e-4a8e-45c4-bdf5-9365e2448f6e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.337424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.337932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.338078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.338348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.338573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.338725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.339066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.339348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.339448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.341248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.377890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:58.395952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.397375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.406621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1045/2074] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:57:58.417680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1030/2075] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:57:58 2022] POST /identity/v3/projects => generated 409 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:57:58.420995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.431857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a469-f3f1-449a-a95f-0585f0353c1a service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.488959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.489620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.489904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.490183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.490915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.493333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.604312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1046/2076] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:57:58 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:57:58.608183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.619051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa3ab9-5358-43c8-ad12-0ea28ab69725 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.624074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.624778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.625063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.625335 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.626103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.627731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.639178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1031/2077] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:58.643329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.653348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48fcd-b2c5-465f-8944-0194daab10aa admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.657865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.658760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.659039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.659311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] PATH_INFO: `/v3/projects/f675ca59edf84a718f0432a86f5aea06/users/c6834417ea2a4bb7b9a407310ecf3787/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.673738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f675ca59edf84a718f0432a86f5aea06, user_id=c6834417ea2a4bb7b9a407310ecf3787, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.676406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.801705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1047/2078] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:58 2022] PUT /identity/v3/projects/f675ca59edf84a718f0432a86f5aea06/users/c6834417ea2a4bb7b9a407310ecf3787/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:57:58.806530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.818577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eea22-217e-48dd-abeb-03c7a77e8888 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.956427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277cd0-58d1-4c42-b06d-7c99a2c6fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.957139 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277cd0-58d1-4c42-b06d-7c99a2c6fc3d admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.957475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277cd0-58d1-4c42-b06d-7c99a2c6fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.957687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277cd0-58d1-4c42-b06d-7c99a2c6fc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.958493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277cd0-58d1-4c42-b06d-7c99a2c6fc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:58.960200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277cd0-58d1-4c42-b06d-7c99a2c6fc3d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:58.962624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:57:58.975184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1032/2079] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:57:58.977383 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:58.988786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e8e0-8561-4999-86e6-a9c5b9a2c996 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:58.994078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:58.994990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:58.995286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:58.995546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] PATH_INFO: `/v3/projects/f675ca59edf84a718f0432a86f5aea06/users/c6834417ea2a4bb7b9a407310ecf3787/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:58.997556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f675ca59edf84a718f0432a86f5aea06, user_id=c6834417ea2a4bb7b9a407310ecf3787, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:59.000218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:59.012939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1048/2080] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:57:58 2022] PUT /identity/v3/projects/f675ca59edf84a718f0432a86f5aea06/users/c6834417ea2a4bb7b9a407310ecf3787/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:57:59.030261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:59.030502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:59.030916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:59.059220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] MFA Rules not processed for user `c6834417ea2a4bb7b9a407310ecf3787`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:57:59.061415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:57:59.129996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1033/2081] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:57:59.148520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:59.210277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4b369-d8c0-4a4a-8558-39163596e6af admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:59.214736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:59.215455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:59.215744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:59.216023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:59.225851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:59.229797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:59.241146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1049/2082] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:57:59.571171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:57:59.580528 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98dc5-1bd4-4131-bbf5-7acb7d9bf59b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:57:59.583993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208914-feb4-48bd-a1a5-238a52620436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:57:59.584624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208914-feb4-48bd-a1a5-238a52620436 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:57:59.584912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208914-feb4-48bd-a1a5-238a52620436 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:57:59.585186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208914-feb4-48bd-a1a5-238a52620436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:57:59.641903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e208914-feb4-48bd-a1a5-238a52620436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:57:59.643399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e208914-feb4-48bd-a1a5-238a52620436 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:57:59.653559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1034/2083] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:00.280392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:00.281810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:00.331988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:00.360885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432ebf4-92ee-4b7b-b06d-ff99e3345e92 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:00.365928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:00.366832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:00.367116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:00.367439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] PATH_INFO: `/v3/users/7180e8eabead4a749d3ca307b7bd6c94` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:00.369170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7180e8eabead4a749d3ca307b7bd6c94)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:00.371140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:00.526307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7180e8eabead4a749d3ca307b7bd6c94'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:00.527103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7180e8eabead4a749d3ca307b7bd6c94'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:00.564216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7180e8eabead4a749d3ca307b7bd6c94'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:00.572548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7180e8eabead4a749d3ca307b7bd6c94'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:00.588407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7180e8eabead4a749d3ca307b7bd6c94'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:00.594423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1050/2084] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:00 2022] DELETE /identity/v3/users/7180e8eabead4a749d3ca307b7bd6c94 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:00.599213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:00.599665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:00.599766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:00.617312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:00.618835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:00.679912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1035/2085] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:00.691439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:00.692978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:00.775760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33a60-ddc0-40ca-b211-2996d211b9fa admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:00.779447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:00.780083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:00.780367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:00.780644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:00.790198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:00.791722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:00.801237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1051/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:01.253022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:01.259293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:01.299155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72491ff-1d40-4fe5-b3bc-9f84a94dfafb None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:01.314309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:01.315315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:01.315603 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:01.315882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] PATH_INFO: `/v3/projects/ca8c2049e516484989c31985a271e00b` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:01.319783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8c2049e516484989c31985a271e00b)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:01.321794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:01.342038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:01.438677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8c2049e516484989c31985a271e00b', 'request_id': 'req-66a7baa9-a464-42c5-8423-528c6c20c393'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.451764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8c2049e516484989c31985a271e00b', 'request_id': 'req-66a7baa9-a464-42c5-8423-528c6c20c393'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.506424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8c2049e516484989c31985a271e00b', 'request_id': 'req-66a7baa9-a464-42c5-8423-528c6c20c393'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.521369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] The token cache is being invalidate because project ca8c2049e516484989c31985a271e00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:01.521765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.522686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.524857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1036/2087] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:01 2022] DELETE /identity/v3/projects/ca8c2049e516484989c31985a271e00b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:01.530199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:01.540511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80181ac8-a677-4c8c-acb0-780f9927341e service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:01.598737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:01.608563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:01.609710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:01.610165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:01.610621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] PATH_INFO: `/v3/users/bf89475883d74c90ab64ab25869027e8` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:01.612024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf89475883d74c90ab64ab25869027e8)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:01.614339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:01.823208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf89475883d74c90ab64ab25869027e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.823925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf89475883d74c90ab64ab25869027e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.901083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf89475883d74c90ab64ab25869027e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.908232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf89475883d74c90ab64ab25869027e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.920724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf89475883d74c90ab64ab25869027e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:01.926620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1052/2088] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:01 2022] DELETE /identity/v3/users/bf89475883d74c90ab64ab25869027e8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:02.461117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:02.462832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:02.476339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7baa9-a464-42c5-8423-528c6c20c393 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:02.536889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:02.538402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:02.554361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:02.555312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:02.556121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:02.556498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] PATH_INFO: `/v3/projects/59f451bb4e7044a7a30f37a5d8ce6847` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:02.557662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f451bb4e7044a7a30f37a5d8ce6847)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:02.560492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:02.614902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba2941-cf5c-4c72-9b0e-2a13ecac19f4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:02.620123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:02.620989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:02.621276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:02.621558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] PATH_INFO: `/v3/users/c4240da6bcca4522b9928f04e045934a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:02.622781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4240da6bcca4522b9928f04e045934a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:02.624708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:02.671909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f451bb4e7044a7a30f37a5d8ce6847', 'request_id': 'req-ce8fc185-7644-40ed-8c98-0405a1bb6d88'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.677993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f451bb4e7044a7a30f37a5d8ce6847', 'request_id': 'req-ce8fc185-7644-40ed-8c98-0405a1bb6d88'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.746499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f451bb4e7044a7a30f37a5d8ce6847', 'request_id': 'req-ce8fc185-7644-40ed-8c98-0405a1bb6d88'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.758003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] The token cache is being invalidate because project 59f451bb4e7044a7a30f37a5d8ce6847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:02.758295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.759026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ce8fc185-7644-40ed-8c98-0405a1bb6d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.760622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1037/2089] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:02 2022] DELETE /identity/v3/projects/59f451bb4e7044a7a30f37a5d8ce6847 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:02.765242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e06b-46ed-4fa2-9e13-7f92bcafa92b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:02.765555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e06b-46ed-4fa2-9e13-7f92bcafa92b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:02.765833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e06b-46ed-4fa2-9e13-7f92bcafa92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:02.783745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a874e06b-46ed-4fa2-9e13-7f92bcafa92b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:02.784943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a874e06b-46ed-4fa2-9e13-7f92bcafa92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:02.803509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4240da6bcca4522b9928f04e045934a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.804214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4240da6bcca4522b9928f04e045934a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.817914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:02.845772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1038/2090] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:02.854372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:02.854690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:02.854969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:02.873546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:02.874857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:02.882881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1039/2091] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:02.887140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:02.889549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4240da6bcca4522b9928f04e045934a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.896337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aad1a-a986-4ae2-a819-0982df071dd1 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:02.898270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4240da6bcca4522b9928f04e045934a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.901593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:02.902324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:02.902612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:02.902803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:02.903522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:58:02.903828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:02.905456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:02.910906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:02.913744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-eebe5ed1-a145-4cb9-bf1e-1bd96c9b0968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4240da6bcca4522b9928f04e045934a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:02.922526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1040/2092] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:58:02.923552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:02.925230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:02.927148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1053/2093] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:02 2022] DELETE /identity/v3/users/c4240da6bcca4522b9928f04e045934a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:02.935444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:02.935995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:02.936562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:02.938189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5f38d-d760-473d-8ebb-bddc33cad403 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:02.959015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:02.960259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:03.002748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.003427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.004008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.004182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.004916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.007385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.034350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1054/2094] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:03.045739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.047152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:03.105361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88a50-8cb2-49c1-896b-db4a34845fc3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.109106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.109747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.110032 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.110315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.119620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.121025 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.130386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1055/2095] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:58:03.138644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1041/2096] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:02 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:03.142741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.154951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803e83d-1ca1-4445-8808-672462361155 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.222753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.223724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.224018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.224364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.225124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.227946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.310320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1056/2097] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:03 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:03.311752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.326382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb67cf6-b8c1-4ae2-a1a5-ac7233398d14 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.332058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.332058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.332281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.334458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.334458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.335011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.351361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1042/2098] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:03.352577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.365564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e141a3-b1e6-461a-a153-fc3b4aaf2383 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.370994 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3811a-7cbe-4108-b43a-b42cde9bca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.371534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3811a-7cbe-4108-b43a-b42cde9bca74 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.371935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3811a-7cbe-4108-b43a-b42cde9bca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.372324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3811a-7cbe-4108-b43a-b42cde9bca74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.373166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3811a-7cbe-4108-b43a-b42cde9bca74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.375317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3811a-7cbe-4108-b43a-b42cde9bca74 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.389858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1057/2099] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:03.395484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.409672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299bc9-6773-4e82-866c-964ef5f09fca admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.428538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.429590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.430065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.430439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] PATH_INFO: `/v3/projects/e22a37c386a94573b25144ee3cba184d/users/a226f083d0444c45a936b9aa36d86133/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.455391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22a37c386a94573b25144ee3cba184d, user_id=a226f083d0444c45a936b9aa36d86133, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.458127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.538470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1043/2100] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:03 2022] PUT /identity/v3/projects/e22a37c386a94573b25144ee3cba184d/users/a226f083d0444c45a936b9aa36d86133/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:03.543338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.543771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.544264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.562334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:03.563683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:03.606121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:03.650535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1058/2101] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:03.657948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.751088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dcd7c-e409-4233-9e1a-747885d33e59 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.757225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9161-4c66-4aa1-b8e8-a1461032ef73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.757948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9161-4c66-4aa1-b8e8-a1461032ef73 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.758236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9161-4c66-4aa1-b8e8-a1461032ef73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.759131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9161-4c66-4aa1-b8e8-a1461032ef73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.763035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:03.765156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:03.807414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:03.843652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9161-4c66-4aa1-b8e8-a1461032ef73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.845182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9161-4c66-4aa1-b8e8-a1461032ef73 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.872017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1044/2102] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:03.886405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638eba5-acfa-4d96-8a75-73e2a35c0da7 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:03.891843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:03.892746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:03.893056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:03.893335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] PATH_INFO: `/v3/projects/18a734e39a6940b1b75c60b079750074` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:03.895963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a734e39a6940b1b75c60b079750074)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:03.897926 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:03.999203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a734e39a6940b1b75c60b079750074', 'request_id': 'req-06c09fe0-333c-4db5-a91e-217374ff828b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:04.005125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a734e39a6940b1b75c60b079750074', 'request_id': 'req-06c09fe0-333c-4db5-a91e-217374ff828b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:04.072400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a734e39a6940b1b75c60b079750074', 'request_id': 'req-06c09fe0-333c-4db5-a91e-217374ff828b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:04.083896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] The token cache is being invalidate because project 18a734e39a6940b1b75c60b079750074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:04.084184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:04.084828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-06c09fe0-333c-4db5-a91e-217374ff828b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:04.086382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1059/2103] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:03 2022] DELETE /identity/v3/projects/18a734e39a6940b1b75c60b079750074 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:04.091329 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.091619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.091893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.139430 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:04.140620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:04.207894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1045/2104] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:04.215899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.216186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.216465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.235581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:04.237142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:04.246085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1060/2105] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:04.251772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:04.261357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43fd3-f2df-426f-9e13-debe306ab585 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:04.265980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:04.266653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.266941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.267220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.267947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:58:04.268253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:04.269844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:04.281928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1046/2106] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:58:04.286226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:04.296685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6f1a-12e2-4383-b664-dc652c1e2926 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:04.301788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:04.302450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.302765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.305984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.305984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:04.306290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:04.400802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1061/2107] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:04 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:04.404795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:04.415323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4e431-e3c9-459d-aae3-0507e756dc4d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:04.480096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:04.480765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.481050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.481330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.482052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:04.484113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:04.605729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1047/2108] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:04 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:04.609793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:04.622172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a6286-48ea-4a15-a043-644a1cd3d1bb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:04.627021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:04.627760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.628140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.628429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.629173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:04.630873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:04.633149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:04.644198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1062/2109] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:04.650354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:04.666801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dd08b-90ba-4c60-bee4-149d4b3eea6b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:04.673159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d6fbd-bad8-4511-8428-947b1596f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:04.675322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d6fbd-bad8-4511-8428-947b1596f421 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.675322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d6fbd-bad8-4511-8428-947b1596f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.675322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d6fbd-bad8-4511-8428-947b1596f421 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.675647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d6fbd-bad8-4511-8428-947b1596f421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:04.677330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d6fbd-bad8-4511-8428-947b1596f421 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:04.692664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1048/2110] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:04.696452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:04.706197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74cd2-12c6-4009-a129-d6513159769b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:04.710875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:04.712295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.712577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.712855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] PATH_INFO: `/v3/projects/3dc41812e2864345b7a48a4280ebd915/users/9387de49acfc4011b9ff35a2aaee4abd/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.730080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc41812e2864345b7a48a4280ebd915, user_id=9387de49acfc4011b9ff35a2aaee4abd, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:04.732817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:04.861433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1063/2111] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:04 2022] PUT /identity/v3/projects/3dc41812e2864345b7a48a4280ebd915/users/9387de49acfc4011b9ff35a2aaee4abd/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:04.873793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:04.874080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:04.874963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:04.923203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] MFA Rules not processed for user `9387de49acfc4011b9ff35a2aaee4abd`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:04.923203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:04.932148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:04.993462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1049/2112] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:04.999821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.071472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673443a-3583-4d1d-b295-009c1fe9cab5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.076272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42e278-0b01-46dc-bd47-19a5e9947544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.077338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e278-0b01-46dc-bd47-19a5e9947544 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.077338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e278-0b01-46dc-bd47-19a5e9947544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.077599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e278-0b01-46dc-bd47-19a5e9947544 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.078248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e278-0b01-46dc-bd47-19a5e9947544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.080230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e278-0b01-46dc-bd47-19a5e9947544 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.259191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1064/2113] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:04 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:05.260069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.270814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc0889-a8e4-4215-a8df-0d00a440bcef None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.332638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.333382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.333382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.350914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.351733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.352056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.352422 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.353160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.355162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.362545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] MFA Rules not processed for user `a226f083d0444c45a936b9aa36d86133`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:05.363800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:05.424144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1050/2114] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:05.427916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.430725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1065/2115] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:05.435202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.436619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:05.439122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e5bed-1cd5-4174-9d47-87bf3431da62 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.444005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.444649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.444931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.445205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.446571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.448206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.451854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b6562-ac90-4a2a-9f00-f47733223a9f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.456595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.457244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.457525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.457800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.458487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.459946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1051/2116] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:05.468453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.471166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.480926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb992-e361-4f47-88ea-e88c6ed94774 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.485421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.486055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.486333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.486631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.487343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.488939 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.499644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1052/2117] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:58:05.503513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.513219 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd353b84-e134-4fbd-a024-075f23d0a038 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.517842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963dc0c-8487-40a4-a36e-2974425a7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.518842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963dc0c-8487-40a4-a36e-2974425a7479 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.519849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963dc0c-8487-40a4-a36e-2974425a7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.520126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963dc0c-8487-40a4-a36e-2974425a7479 admin admin] PATH_INFO: `/v3/projects/9cdee03a1a3a476f86675b81942b5499/users/d1ac6a6463e848c885bfeda1b794cd13/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.533666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963dc0c-8487-40a4-a36e-2974425a7479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdee03a1a3a476f86675b81942b5499, user_id=d1ac6a6463e848c885bfeda1b794cd13, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.536322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963dc0c-8487-40a4-a36e-2974425a7479 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.557667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1066/2118] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:05.558746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.594098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:05.624137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a293ba-827a-4d24-88e9-ec5ccaefd471 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.625771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.626422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.626735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.627010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.627687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.629616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.649811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1053/2119] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:05 2022] PUT /identity/v3/projects/9cdee03a1a3a476f86675b81942b5499/users/d1ac6a6463e848c885bfeda1b794cd13/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:05.660419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.660731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.661003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.690604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] MFA Rules not processed for user `d1ac6a6463e848c885bfeda1b794cd13`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:05.692375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:05.724381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1067/2120] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:05.728888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.739156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ca17-b268-45c7-a51b-b51ad4ebcbed admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.739692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:05.764208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1054/2121] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:05.768770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.797193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.797862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.798146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.798423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.799373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.800982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.814634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1068/2122] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:58:05.815721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.825260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8cb05-f734-463b-a669-59296e448915 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.829912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.830805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.831085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.831358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] PATH_INFO: `/v3/projects/d694686339e04b61a600e2e30dead7c1/users/313b2f3804d64682a55670bdc2b0a325/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.833972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41ad50-171d-4113-bff7-e20f543347f8 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:05.838509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:05.839198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:05.839481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:05.839754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:05.840438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.842332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.846109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d694686339e04b61a600e2e30dead7c1, user_id=313b2f3804d64682a55670bdc2b0a325, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:05.849026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:05.974540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1055/2123] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:05.979305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:05.991300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1069/2124] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:05 2022] PUT /identity/v3/projects/d694686339e04b61a600e2e30dead7c1/users/313b2f3804d64682a55670bdc2b0a325/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:05.994995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.076860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c5d22-368d-4ccf-8006-2bbf5e54d8a8 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.082598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.083282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.083572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.088946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.088946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.088946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.106360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34e53-d315-4737-a293-6d70b6b8a50f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.111157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.113125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.113125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.113125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.113125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.114718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.124858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1070/2125] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:58:06.128951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.138535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8450-66e8-4dee-89b7-18797d22f9f2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.154375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.155309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.160845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.160845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] PATH_INFO: `/v3/projects/d694686339e04b61a600e2e30dead7c1/users/313b2f3804d64682a55670bdc2b0a325/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.160845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d694686339e04b61a600e2e30dead7c1, user_id=313b2f3804d64682a55670bdc2b0a325, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.160845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.171739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1071/2126] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:06 2022] PUT /identity/v3/projects/d694686339e04b61a600e2e30dead7c1/users/313b2f3804d64682a55670bdc2b0a325/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:06.225133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1056/2127] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:05 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:06.226369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.240467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:06.291393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba02d9-f1dd-4768-9cfe-4926dcf5c2c2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.296862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.297655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.297943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.298266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.299040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.300648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.315315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1072/2128] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:06.316690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.327558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e415-5e48-45e8-9ba5-a3f106d1c02c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.332316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.333327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.333701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.333886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] PATH_INFO: `/v3/projects/06efb57afa3c46378a95fad1d364b94d/users/44886d467eb0437eb72ebabc9f0e2a5c/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.356595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06efb57afa3c46378a95fad1d364b94d, user_id=44886d467eb0437eb72ebabc9f0e2a5c, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.359396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.449926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1057/2129] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:06 2022] PUT /identity/v3/projects/06efb57afa3c46378a95fad1d364b94d/users/44886d467eb0437eb72ebabc9f0e2a5c/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:06.453757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.463566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea364cfc-e556-408f-b86a-55270ded1724 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.527317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.528234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.528530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.528980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.529847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.531548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.545730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1073/2130] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:06.547089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.558479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a48a3f-07cd-48b8-9fe2-3ecdcf8ff531 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.563997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8634bdc-1d6f-4ec6-acb2-a10c00574e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.565075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634bdc-1d6f-4ec6-acb2-a10c00574e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.565457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634bdc-1d6f-4ec6-acb2-a10c00574e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.565836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634bdc-1d6f-4ec6-acb2-a10c00574e98 admin admin] PATH_INFO: `/v3/projects/06efb57afa3c46378a95fad1d364b94d/users/44886d467eb0437eb72ebabc9f0e2a5c/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.568298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8634bdc-1d6f-4ec6-acb2-a10c00574e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06efb57afa3c46378a95fad1d364b94d, user_id=44886d467eb0437eb72ebabc9f0e2a5c, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.571301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8634bdc-1d6f-4ec6-acb2-a10c00574e98 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.582721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1058/2131] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:06 2022] PUT /identity/v3/projects/06efb57afa3c46378a95fad1d364b94d/users/44886d467eb0437eb72ebabc9f0e2a5c/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:06.593393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.595315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:06.600311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.600604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.600874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.618307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c841b-902b-4dfa-913d-0810e83225cd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.634505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] MFA Rules not processed for user `44886d467eb0437eb72ebabc9f0e2a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:06.635798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:06.644502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:06.677938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.678851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.679139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.679420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] PATH_INFO: `/v3/users/2b5a3ca095c240359f088f94f77f3717` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.680716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5a3ca095c240359f088f94f77f3717)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.682934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.726291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1059/2132] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:06.737870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:06.739534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:06.816415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa74-f9b1-49be-b385-375a1fcf18ae None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:06.820104 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdd5c3-213b-443b-885a-88203fcacff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:06.820746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdd5c3-213b-443b-885a-88203fcacff6 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:06.821604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdd5c3-213b-443b-885a-88203fcacff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:06.821880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdd5c3-213b-443b-885a-88203fcacff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:06.893705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdd5c3-213b-443b-885a-88203fcacff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:06.895182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdd5c3-213b-443b-885a-88203fcacff6 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:06.904167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1060/2133] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:58:06.968628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:06.975710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5a3ca095c240359f088f94f77f3717'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:06.976562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5a3ca095c240359f088f94f77f3717'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:07.038624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5a3ca095c240359f088f94f77f3717'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:07.048336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5a3ca095c240359f088f94f77f3717'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:07.067262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5a3ca095c240359f088f94f77f3717'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:07.074415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1074/2134] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:06 2022] DELETE /identity/v3/users/2b5a3ca095c240359f088f94f77f3717 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:07.086731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e3c6-d4cb-41cb-acc7-9bab5c286ae2 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:07.087060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e3c6-d4cb-41cb-acc7-9bab5c286ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:07.087294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e3c6-d4cb-41cb-acc7-9bab5c286ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:07.106441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-da46e3c6-d4cb-41cb-acc7-9bab5c286ae2 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:07.108160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-da46e3c6-d4cb-41cb-acc7-9bab5c286ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:07.154546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:07.173373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1061/2135] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:07.183759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:07.185179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:07.267370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef36086-b8f5-489a-a258-408dfeb8a602 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:07.273051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:07.273908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:07.274249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:07.274537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:07.285996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:07.287969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:07.299727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1075/2136] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:07.780882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf44e-ac08-4448-aa6f-377e05cac394 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:07.781349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf44e-ac08-4448-aa6f-377e05cac394 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:07.781589 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf44e-ac08-4448-aa6f-377e05cac394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:07.828354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-44baf44e-ac08-4448-aa6f-377e05cac394 None None] MFA Rules not processed for user `313b2f3804d64682a55670bdc2b0a325`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:07.831860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-44baf44e-ac08-4448-aa6f-377e05cac394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:07.915557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:07.918148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:07.922794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1062/2137] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:07.936583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:07.936985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:07.937273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:07.944839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f7bc-d82a-4217-941d-f584e77f8917 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:07.950175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:07.951064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:07.951495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:07.953099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] PATH_INFO: `/v3/projects/68b5283ad5c34d9ebf7dff99eb7a4435` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:07.954434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b5283ad5c34d9ebf7dff99eb7a4435)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:07.956715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:07.972245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] MFA Rules not processed for user `a226f083d0444c45a936b9aa36d86133`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:07.973464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:08.030027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1063/2138] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:08.041629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:08.043045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:08.086680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b5283ad5c34d9ebf7dff99eb7a4435', 'request_id': 'req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.092631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b5283ad5c34d9ebf7dff99eb7a4435', 'request_id': 'req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.117622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047ffc7-821b-4663-9f71-fa6437553e8d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:08.126869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:08.169793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b5283ad5c34d9ebf7dff99eb7a4435', 'request_id': 'req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.180611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:08.181338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:08.181626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] The token cache is being invalidate because project 68b5283ad5c34d9ebf7dff99eb7a4435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:08.181727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:08.181922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.182142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:08.182606 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.184050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:08.184182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1076/2139] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:07 2022] DELETE /identity/v3/projects/68b5283ad5c34d9ebf7dff99eb7a4435 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:08.188002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:08.189310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:08.220612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:08.243906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:08.245941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:08.253335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9ddf-3e72-4105-a83e-f3b12a62f7bd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:08.254928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1064/2140] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:58:08.258272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:08.259721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:08.260002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:08.260282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] PATH_INFO: `/v3/users/c6834417ea2a4bb7b9a407310ecf3787` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:08.264179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6834417ea2a4bb7b9a407310ecf3787)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:08.264179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:08.486146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6834417ea2a4bb7b9a407310ecf3787'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.486822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6834417ea2a4bb7b9a407310ecf3787'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.580890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6834417ea2a4bb7b9a407310ecf3787'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.588504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6834417ea2a4bb7b9a407310ecf3787'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.600939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6834417ea2a4bb7b9a407310ecf3787'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:08.607707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1077/2141] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:08 2022] DELETE /identity/v3/users/c6834417ea2a4bb7b9a407310ecf3787 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:09.115830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:09.117308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:09.195735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18aa47-0f77-4e71-ba06-d07e1e7ad976 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:09.249198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:09.249843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:09.250153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:09.250461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:09.252266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:09.266924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:09.268997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:09.324446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:09.373062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8652c-9a36-4667-9f37-3c465c713f63 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:09.381204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:09.382567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:09.383411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:09.384177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] PATH_INFO: `/v3/projects/f675ca59edf84a718f0432a86f5aea06` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:09.385849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f675ca59edf84a718f0432a86f5aea06)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:09.388186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:09.388952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:09.389621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6fd6-0cc4-40d3-8669-a91ace2db949 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:09.401916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1065/2142] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:09.490409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f675ca59edf84a718f0432a86f5aea06', 'request_id': 'req-bc234437-0c1b-474f-b4d1-dc7c2df3754f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:09.492522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:09.499374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f675ca59edf84a718f0432a86f5aea06', 'request_id': 'req-bc234437-0c1b-474f-b4d1-dc7c2df3754f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:09.576766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f675ca59edf84a718f0432a86f5aea06', 'request_id': 'req-bc234437-0c1b-474f-b4d1-dc7c2df3754f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:09.599077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] The token cache is being invalidate because project f675ca59edf84a718f0432a86f5aea06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:09.599396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:09.600761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bc234437-0c1b-474f-b4d1-dc7c2df3754f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:09.602890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1078/2143] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:09 2022] DELETE /identity/v3/projects/f675ca59edf84a718f0432a86f5aea06 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:09.607779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:09.608074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:09.608986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:09.627590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:09.628850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:09.704397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1066/2144] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:09.715664 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:09.716180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:09.716617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:09.741890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:09.743750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:09.752880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1079/2145] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:09.757202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:09.767695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b629ac9-3398-49da-9048-0e83cc152809 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:09.772491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:09.773156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:09.773516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:09.773775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:09.774527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:58:09.774902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:09.776502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:09.789159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1067/2146] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:58:09.793673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:09.803870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35236bf3-4c24-490f-b4a6-9d8c6459f537 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:09.809848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:09.810530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:09.810856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:09.811136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:09.811911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:09.814350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:09.951140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1080/2147] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:09 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:09.955751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:09.977536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88318-7179-4892-bbd1-56493b35726f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:10.103407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:10.104096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:10.104376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:10.104654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:10.105737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:10.107570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:10.250646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1068/2148] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:09 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:10.254795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:10.267017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1fb3-6ddc-4c0b-950e-3f0801353d4b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:10.273083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:10.273803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:10.274898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:10.275326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:10.276211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:10.278381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:10.292348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1081/2149] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:10.296333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:10.306917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f18485-1a74-4b68-8325-c3f7781eb276 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:10.312011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060477b-c597-4252-bbda-114ec0269537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:10.313513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060477b-c597-4252-bbda-114ec0269537 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:10.313513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060477b-c597-4252-bbda-114ec0269537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:10.313513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060477b-c597-4252-bbda-114ec0269537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:10.314307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060477b-c597-4252-bbda-114ec0269537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:10.316061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060477b-c597-4252-bbda-114ec0269537 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:10.327550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1069/2150] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:10.331939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:10.348045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08cfe-4b3a-4e39-80ab-0642a3e8cad5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:10.357775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:10.358982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:10.359264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:10.359544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] PATH_INFO: `/v3/projects/6391748ec826480fb756ee960b97f9f8/users/c310eec7aad2463c80a1e6cdcca64c5c/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:10.380028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6391748ec826480fb756ee960b97f9f8, user_id=c310eec7aad2463c80a1e6cdcca64c5c, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:10.382853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:10.459037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1082/2151] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:10 2022] PUT /identity/v3/projects/6391748ec826480fb756ee960b97f9f8/users/c310eec7aad2463c80a1e6cdcca64c5c/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:10.472545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:10.473121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:10.473820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:10.516484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] MFA Rules not processed for user `c310eec7aad2463c80a1e6cdcca64c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:10.518060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:10.533625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:10.594135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1070/2152] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:10.605795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:10.607665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:10.672713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43617a3-353b-4c8d-908f-23368c11b926 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:10.676422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036dd29-4c22-4197-82a9-a1f914a9ad39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:10.677026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036dd29-4c22-4197-82a9-a1f914a9ad39 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:10.677316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036dd29-4c22-4197-82a9-a1f914a9ad39 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:10.677594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036dd29-4c22-4197-82a9-a1f914a9ad39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:10.688012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036dd29-4c22-4197-82a9-a1f914a9ad39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:10.689470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036dd29-4c22-4197-82a9-a1f914a9ad39 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:10.700320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1083/2153] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:11.225956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:11.228001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:11.244479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f1ac-4103-4df8-84b1-a317fe8d7818 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:11.248901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:11.250167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:11.250449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:11.250769 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:11.252727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:11.328756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:11.330322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:11.340604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1071/2154] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:12.893466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001bb1c-cff5-4c0c-8bfc-94a8e5663117 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:12.893906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001bb1c-cff5-4c0c-8bfc-94a8e5663117 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:12.894104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001bb1c-cff5-4c0c-8bfc-94a8e5663117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:12.912240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8001bb1c-cff5-4c0c-8bfc-94a8e5663117 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:12.913472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8001bb1c-cff5-4c0c-8bfc-94a8e5663117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:12.970131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1084/2155] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:13.016257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:13.019221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:13.109255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8f4d3-32d1-4af2-a79e-1293eb8cc251 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:13.114885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:13.115537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:13.115820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:13.116094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:13.126052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:13.127661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:13.144510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1072/2156] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:58:14.017829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603116-c48e-41f6-8ba5-d569d72e2de5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:14.018333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603116-c48e-41f6-8ba5-d569d72e2de5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:14.018536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603116-c48e-41f6-8ba5-d569d72e2de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:14.038786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-09603116-c48e-41f6-8ba5-d569d72e2de5 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:14.040743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-09603116-c48e-41f6-8ba5-d569d72e2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:14.048153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1085/2157] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jun 16 11:58:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:14.062811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:14.072605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854aa5b-09f8-40ae-8d38-c8dfa7d2795b service swift] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:14.082302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:14.082302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:14.082302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:14.082302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:14.088576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:14.090171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:14.099674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1073/2158] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:58:14.921650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfdd79-10b5-446d-8ab6-f29621c5a0a5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:14.921950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfdd79-10b5-446d-8ab6-f29621c5a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:14.922526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfdd79-10b5-446d-8ab6-f29621c5a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:14.948279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-acbfdd79-10b5-446d-8ab6-f29621c5a0a5 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:14.949785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-acbfdd79-10b5-446d-8ab6-f29621c5a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:14.969555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1086/2159] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:58:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:14.988658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:15.001693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07519-66ca-4c85-8253-81d9b70ce904 service swift] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:15.014652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:15.015440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:15.015793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:15.016144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:15.032474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:15.034262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:15.043983 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1074/2160] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:58:15.637016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:15.637586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:15.637586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:15.655397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:15.656609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:15.666230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1087/2161] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jun 16 11:58:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:15.681806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:15.693908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db45680-5af9-481b-bd0e-4888aeced31a service swift] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:15.699861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351bae6-5eef-48a5-b835-9138dc7c65d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:15.700628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351bae6-5eef-48a5-b835-9138dc7c65d5 service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:15.701087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351bae6-5eef-48a5-b835-9138dc7c65d5 service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:15.701369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351bae6-5eef-48a5-b835-9138dc7c65d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:15.709935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351bae6-5eef-48a5-b835-9138dc7c65d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:15.711564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351bae6-5eef-48a5-b835-9138dc7c65d5 service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:15.718911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:15.723721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1075/2162] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:58:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:58:16.372760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:16.374507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:16.379855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:16.478262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad6fa9-18ef-434a-b9ed-287829f4f4ee None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:16.482570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:16.483530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:16.483810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:16.484088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] PATH_INFO: `/v3/users/9387de49acfc4011b9ff35a2aaee4abd` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:16.485391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9387de49acfc4011b9ff35a2aaee4abd)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:16.487501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:16.701593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9387de49acfc4011b9ff35a2aaee4abd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:16.704748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9387de49acfc4011b9ff35a2aaee4abd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:16.821728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9387de49acfc4011b9ff35a2aaee4abd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:16.835432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9387de49acfc4011b9ff35a2aaee4abd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:16.874133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9387de49acfc4011b9ff35a2aaee4abd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:16.891080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1088/2163] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:16 2022] DELETE /identity/v3/users/9387de49acfc4011b9ff35a2aaee4abd => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:16.896292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f93c-d69b-4689-941c-696edfb97751 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:16.896763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f93c-d69b-4689-941c-696edfb97751 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:16.896842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f93c-d69b-4689-941c-696edfb97751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:16.917774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-fb74f93c-d69b-4689-941c-696edfb97751 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:16.919057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-fb74f93c-d69b-4689-941c-696edfb97751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:16.996913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1076/2164] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:17.007523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:17.009258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:17.084211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ee7c-d66d-4ba8-b34f-d8fb8751be61 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:17.095854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:17.096619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:17.097007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:17.100153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:17.112486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:17.114114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:17.126293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1089/2165] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:17.599594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:17.599893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:17.600198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:17.634336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] MFA Rules not processed for user `daeda01f27034ddcafe45bd8f7d15a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:17.635650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:17.731239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1077/2166] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:17.755103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:17.757646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:17.775163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7073d-e715-415c-9115-2b6d16c68e46 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:17.782633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:17.783522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:17.783811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:17.784093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] PATH_INFO: `/v3/projects/3dc41812e2864345b7a48a4280ebd915` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:17.787082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc41812e2864345b7a48a4280ebd915)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:17.789106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:17.844859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:17.989543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc41812e2864345b7a48a4280ebd915', 'request_id': 'req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:17.996232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc41812e2864345b7a48a4280ebd915', 'request_id': 'req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.067382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc41812e2864345b7a48a4280ebd915', 'request_id': 'req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.088300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] The token cache is being invalidate because project 3dc41812e2864345b7a48a4280ebd915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:18.088547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.089234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.090864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1090/2167] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:17 2022] DELETE /identity/v3/projects/3dc41812e2864345b7a48a4280ebd915 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:18.098013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:18.109645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fbfd3-6b41-4b4d-9c00-4890a04286c3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:18.232598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:18.234498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:18.235197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:18.235650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] PATH_INFO: `/v3/users/d1ac6a6463e848c885bfeda1b794cd13` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:18.237043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ac6a6463e848c885bfeda1b794cd13)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:18.239833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:18.460667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ac6a6463e848c885bfeda1b794cd13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.461985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ac6a6463e848c885bfeda1b794cd13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.463337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:18.469529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ac6a6463e848c885bfeda1b794cd13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.581078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ac6a6463e848c885bfeda1b794cd13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.596088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ac6a6463e848c885bfeda1b794cd13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:18.616435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1078/2168] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:18 2022] DELETE /identity/v3/users/d1ac6a6463e848c885bfeda1b794cd13 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:19.175347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:19.178241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:19.191791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9369c-97ee-4d7c-ad45-5a61cf044f74 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:19.228745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:19.230278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:19.261604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:19.262472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:19.262836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:19.263042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] PATH_INFO: `/v3/users/55bb688107034191becad19c37873d41` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:19.264406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bb688107034191becad19c37873d41)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:19.266488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:19.308539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c754-c87e-4cc9-b42f-7fae1c02e545 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:19.313290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:19.314150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:19.314435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:19.314744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] PATH_INFO: `/v3/projects/9cdee03a1a3a476f86675b81942b5499` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:19.315941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdee03a1a3a476f86675b81942b5499)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:19.317897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:19.515057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdee03a1a3a476f86675b81942b5499', 'request_id': 'req-6674b6e8-3d3f-4de5-b838-5791c345c616'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.515273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bb688107034191becad19c37873d41'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.515869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bb688107034191becad19c37873d41'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.522369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdee03a1a3a476f86675b81942b5499', 'request_id': 'req-6674b6e8-3d3f-4de5-b838-5791c345c616'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.621140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bb688107034191becad19c37873d41'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.630214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bb688107034191becad19c37873d41'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.647292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-481f7f7a-6448-43cf-aadc-87ffb2e34ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bb688107034191becad19c37873d41'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.654335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1091/2169] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:19 2022] DELETE /identity/v3/users/55bb688107034191becad19c37873d41 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:19.659054 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:19.659344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:19.659654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:19.661648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdee03a1a3a476f86675b81942b5499', 'request_id': 'req-6674b6e8-3d3f-4de5-b838-5791c345c616'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.675429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] The token cache is being invalidate because project 9cdee03a1a3a476f86675b81942b5499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:19.676069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.676890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.678207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:19.679282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1079/2170] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:19 2022] DELETE /identity/v3/projects/9cdee03a1a3a476f86675b81942b5499 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:19.679498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:19.692088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:19.694542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:19.709305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:19.762944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1092/2171] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:19.771492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:19.774473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:19.791802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674b6e8-3d3f-4de5-b838-5791c345c616 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:19.797415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:19.798344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:19.798898 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:19.799332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] PATH_INFO: `/v3/users/44886d467eb0437eb72ebabc9f0e2a5c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:19.800964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44886d467eb0437eb72ebabc9f0e2a5c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:19.803376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:19.875116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045aec1-0bf2-48db-9fbc-7863aee04285 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:19.880368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:19.881223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:19.881683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:19.882185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:19.899115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:19.900726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:19.912040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1093/2172] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:19.937304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:19.964994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44886d467eb0437eb72ebabc9f0e2a5c'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.973922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44886d467eb0437eb72ebabc9f0e2a5c'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:19.983166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44886d467eb0437eb72ebabc9f0e2a5c'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.061652 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44886d467eb0437eb72ebabc9f0e2a5c'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.082057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44886d467eb0437eb72ebabc9f0e2a5c'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.093925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1080/2173] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:19 2022] DELETE /identity/v3/users/44886d467eb0437eb72ebabc9f0e2a5c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:20.290899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:20.292732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:20.306935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e145e-cc90-4237-93b9-5a379585f28b service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:20.382029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:20.382949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:20.383793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:20.384073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] PATH_INFO: `/v3/projects/af84fb62c36d4f849061e846c86643d6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:20.385923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af84fb62c36d4f849061e846c86643d6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:20.388085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:20.543579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af84fb62c36d4f849061e846c86643d6', 'request_id': 'req-29fe7cc5-0d51-469a-aeb3-d239b014b82e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.550166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af84fb62c36d4f849061e846c86643d6', 'request_id': 'req-29fe7cc5-0d51-469a-aeb3-d239b014b82e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.655387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af84fb62c36d4f849061e846c86643d6', 'request_id': 'req-29fe7cc5-0d51-469a-aeb3-d239b014b82e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.665071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:20.666679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:20.677291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] The token cache is being invalidate because project af84fb62c36d4f849061e846c86643d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:20.677802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.678832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29fe7cc5-0d51-469a-aeb3-d239b014b82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.681510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1094/2174] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:20 2022] DELETE /identity/v3/projects/af84fb62c36d4f849061e846c86643d6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:20.686344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d77e04-40fb-4c10-8982-2635fdd17afe None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:20.686857 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d77e04-40fb-4c10-8982-2635fdd17afe None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:20.687329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d77e04-40fb-4c10-8982-2635fdd17afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:20.690722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bab0c-23b3-4e26-99cc-001667739554 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:20.724298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-65d77e04-40fb-4c10-8982-2635fdd17afe None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:20.725745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-65d77e04-40fb-4c10-8982-2635fdd17afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:20.771029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:20.772377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:20.772780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:20.773148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] PATH_INFO: `/v3/projects/06efb57afa3c46378a95fad1d364b94d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:20.774421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06efb57afa3c46378a95fad1d364b94d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:20.776421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:20.797178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1095/2175] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:20.806441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:20.807082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:20.807368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:20.829760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:20.831061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:20.839695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1096/2176] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:20.855300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:20.865591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84536b8-282a-4aed-94da-e92c63a4f7f5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:20.871068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:20.871738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:20.872160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:20.872466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:20.873196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:58:20.873507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:20.875150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:20.887465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1097/2177] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:58:20.891721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:20.903073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c430-fd7a-4e07-85d0-28ea237fb68c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:20.913007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:20.913007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:20.913007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:20.913007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:20.913490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:20.913490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:20.920051 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06efb57afa3c46378a95fad1d364b94d', 'request_id': 'req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:20.926232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06efb57afa3c46378a95fad1d364b94d', 'request_id': 'req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:21.038407 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06efb57afa3c46378a95fad1d364b94d', 'request_id': 'req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:21.046966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1098/2178] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:20 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:21.052113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.052952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] The token cache is being invalidate because project 06efb57afa3c46378a95fad1d364b94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:21.053246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:21.054154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cee218ec-7daf-4049-a5ca-ee3e32ab62b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:21.056230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1081/2179] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:20 2022] DELETE /identity/v3/projects/06efb57afa3c46378a95fad1d364b94d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:21.060902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d30aac-bb32-4866-9eb8-6723e112f3b7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.061185 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d30aac-bb32-4866-9eb8-6723e112f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.061472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d30aac-bb32-4866-9eb8-6723e112f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.082007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f4d30aac-bb32-4866-9eb8-6723e112f3b7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:21.083334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f4d30aac-bb32-4866-9eb8-6723e112f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:21.138973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1ae63-54a2-4563-a57b-db7656732ad1 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.144581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.144581 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.145019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.145418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.146222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.148373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.217112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1082/2180] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:21.219170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.219548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.219934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.248952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:21.250306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:21.262120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1083/2181] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:21.270207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.281009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667b15-83ad-41b7-9718-0034f0751e66 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.286439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.287245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.290014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.290014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.290209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1099/2182] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:21.290314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:58:21.290314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.291197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.293202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.295020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:21.306237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1084/2183] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:58:21.308129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3974-cecc-4b9a-93a4-83a37a3fc727 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.310258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.314213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.314973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.315269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.315548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.316286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.317918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.322718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0228-ae5c-4701-b39b-ef556dc92d54 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.328067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.330283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.330394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1100/2184] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:21.330488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.330488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.330488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.332372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.333809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.344019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2599ce-76b7-4681-9e27-985dd8a2e7f0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.352649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.352649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.352649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.352649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.353021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.353846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.364778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1101/2185] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:58:21.369534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.379094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b910-4d25-4330-a9b1-a9691b4413fa admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.383761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d72d-8a88-4798-a146-2a69f0b416f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.384689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d72d-8a88-4798-a146-2a69f0b416f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.385011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d72d-8a88-4798-a146-2a69f0b416f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.385307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d72d-8a88-4798-a146-2a69f0b416f4 admin admin] PATH_INFO: `/v3/projects/d0da495fb41a441ca5efeb5e8947710e/users/52c0db58ab734bfdb6b4fd46c6e04f13/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.401303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d72d-8a88-4798-a146-2a69f0b416f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0da495fb41a441ca5efeb5e8947710e, user_id=52c0db58ab734bfdb6b4fd46c6e04f13, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.404016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d72d-8a88-4798-a146-2a69f0b416f4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.440302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1085/2186] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:21.441177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.510147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313fb0a-f0df-4314-8215-868a2a156db5 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.515163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.515954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.516102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.516369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.517053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.519014 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.530778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1102/2187] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:21 2022] PUT /identity/v3/projects/d0da495fb41a441ca5efeb5e8947710e/users/52c0db58ab734bfdb6b4fd46c6e04f13/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:21.535967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.536478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.536830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.568867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:21.572038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:21.622815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1086/2188] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:21.636587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.653069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dcc5d-505d-4f3f-97e8-99f51ba09140 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.666417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1103/2189] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:21.698665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.700587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:21.740491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.741134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.741134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.745926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.745926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.745926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.762465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1087/2190] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:21.766735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.778056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb687f-9d0b-4494-bf4e-b276fbe10892 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.781420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b040a-b3a3-43be-ab48-0cd09a698a8e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.783340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.784484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.784484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.784841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.785925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb8f3-a58d-4572-be0e-2c3fd1cefdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.786479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.786937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb8f3-a58d-4572-be0e-2c3fd1cefdde service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.788538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:21.789099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb8f3-a58d-4572-be0e-2c3fd1cefdde service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.789503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.789780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb8f3-a58d-4572-be0e-2c3fd1cefdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.800074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1088/2191] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:21.802450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeb8f3-a58d-4572-be0e-2c3fd1cefdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.804199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:21.804477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeb8f3-a58d-4572-be0e-2c3fd1cefdde service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.814889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8a4d-1e5a-4079-82a0-df8c26f37989 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:21.817632 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1104/2192] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:21.820738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:21.822175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.822464 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.822975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] PATH_INFO: `/v3/projects/b277578391084eaab077199bc3f17f9d/users/ca7ef5581cc34e5a8581e5cce1a84f6a/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.859432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b277578391084eaab077199bc3f17f9d, user_id=ca7ef5581cc34e5a8581e5cce1a84f6a, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:21.862196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:21.912517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:21.935873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1089/2193] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:21 2022] PUT /identity/v3/projects/b277578391084eaab077199bc3f17f9d/users/ca7ef5581cc34e5a8581e5cce1a84f6a/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:21.946963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:21.952972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:21.952972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:21.977023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] MFA Rules not processed for user `ca7ef5581cc34e5a8581e5cce1a84f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:21.978288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:22.050923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1105/2194] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:22.064870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:22.066893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:22.132455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769857f-46ea-43c3-9e69-f26be627459f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:22.136274 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc14b4-dcff-44f1-a38b-301d1bd718c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:22.136912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc14b4-dcff-44f1-a38b-301d1bd718c6 service glance] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:22.138100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc14b4-dcff-44f1-a38b-301d1bd718c6 service glance] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:22.138100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc14b4-dcff-44f1-a38b-301d1bd718c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:22.146676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc14b4-dcff-44f1-a38b-301d1bd718c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:22.148096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc14b4-dcff-44f1-a38b-301d1bd718c6 service glance] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:22.157527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1090/2195] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:23.143399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:23.144981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:23.223200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892458f7-ae57-4c1a-b102-bbc7a6843666 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:23.230708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:23.231712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:23.231993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:23.232272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] PATH_INFO: `/v3/users/c310eec7aad2463c80a1e6cdcca64c5c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:23.233571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c310eec7aad2463c80a1e6cdcca64c5c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:23.236448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:23.478444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c310eec7aad2463c80a1e6cdcca64c5c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:23.479139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c310eec7aad2463c80a1e6cdcca64c5c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:23.547741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c310eec7aad2463c80a1e6cdcca64c5c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:23.563246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c310eec7aad2463c80a1e6cdcca64c5c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:23.586933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c310eec7aad2463c80a1e6cdcca64c5c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:23.597087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1106/2196] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:23 2022] DELETE /identity/v3/users/c310eec7aad2463c80a1e6cdcca64c5c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:23.602868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:23.603378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:23.603468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:23.624058 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:23.626518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:23.778115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1091/2197] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:23.823120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:23.824652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:24.004409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9c40a-8633-4880-975a-eef5049155f7 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:24.017881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:24.021238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:24.021624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:24.024619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:24.028598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:24.059180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:24.060751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:24.094852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1107/2198] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:24.097064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:24.943560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:24.947829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:24.971823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81aa3e-7356-418a-b1a0-93a68f8b0e31 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:24.981507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:24.982797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:24.987179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:24.987179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] PATH_INFO: `/v3/projects/6391748ec826480fb756ee960b97f9f8` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:24.987179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6391748ec826480fb756ee960b97f9f8)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:24.987179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:25.197955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6391748ec826480fb756ee960b97f9f8', 'request_id': 'req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:25.212906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6391748ec826480fb756ee960b97f9f8', 'request_id': 'req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:25.439539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6391748ec826480fb756ee960b97f9f8', 'request_id': 'req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:25.465129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] The token cache is being invalidate because project 6391748ec826480fb756ee960b97f9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:25.466238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:25.466957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:25.474124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8498845f-cfb6-4650-ab84-6d0d2c1c1c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:25.474124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1092/2199] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:24 2022] DELETE /identity/v3/projects/6391748ec826480fb756ee960b97f9f8 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:25.550505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:26.676748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:26.678802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:26.746841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:26.753960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4255f9-4869-4b98-ab4c-38322a3f3d8b service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:26.818037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:26.818905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:26.819347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:26.819642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:26.822948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:26.959763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:26.961851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:26.974951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1108/2200] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:29.726226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:29.727722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:29.728163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:29.775531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] MFA Rules not processed for user `52c0db58ab734bfdb6b4fd46c6e04f13`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:29.777087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:29.871326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1093/2201] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:29.875442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:29.876884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:29.981589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68fd38-98c3-4f09-9285-a8f24358bda0 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:29.998818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:29.999487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:29.999774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:30.000062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:30.000854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:30.003115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:30.098330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1109/2202] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:29 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:30.102788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:30.115045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d13944-970a-4486-a618-b1348349c5c6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:30.194081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:30.194902 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:30.195257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:30.196370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:30.197373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:30.199438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:30.308251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1094/2203] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:30 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:30.312910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:30.327560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9530-ef53-4069-ad36-31e375eaf6c0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:30.340534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:30.341408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:30.341799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:30.342214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:30.343208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:30.345303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:30.358234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1110/2204] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:30.363399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:30.372892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec748f-8411-4982-9e7e-890613d8fbd4 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:30.378025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:30.378921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:30.379208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:30.379506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] PATH_INFO: `/v3/projects/b3a0c9f7fe0942a8acbe255c3f5f2244/users/8a7779993e0d4691a525b78d1d4ed68a/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:30.406071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a0c9f7fe0942a8acbe255c3f5f2244, user_id=8a7779993e0d4691a525b78d1d4ed68a, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:30.408919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:30.479345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1095/2205] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:30 2022] PUT /identity/v3/projects/b3a0c9f7fe0942a8acbe255c3f5f2244/users/8a7779993e0d4691a525b78d1d4ed68a/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:30.480900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:30.496979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6831-b3c4-4e9f-8f10-624b055ab266 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:30.528053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:30.561682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265effb7-d9a3-42c6-98d6-76c8d0975b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:30.562359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265effb7-d9a3-42c6-98d6-76c8d0975b1a admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:30.562708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265effb7-d9a3-42c6-98d6-76c8d0975b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:30.563033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265effb7-d9a3-42c6-98d6-76c8d0975b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:30.566576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265effb7-d9a3-42c6-98d6-76c8d0975b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:30.566576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265effb7-d9a3-42c6-98d6-76c8d0975b1a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:30.579948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1111/2206] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:30.582451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:30.595169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969142-bf5a-4e82-9da6-50d76c21489d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:30.601460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:30.602189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:30.602756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:30.603070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] PATH_INFO: `/v3/projects/b3a0c9f7fe0942a8acbe255c3f5f2244/users/8a7779993e0d4691a525b78d1d4ed68a/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:30.613962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a0c9f7fe0942a8acbe255c3f5f2244, user_id=8a7779993e0d4691a525b78d1d4ed68a, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:30.621596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:30.636176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1096/2207] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:30 2022] PUT /identity/v3/projects/b3a0c9f7fe0942a8acbe255c3f5f2244/users/8a7779993e0d4691a525b78d1d4ed68a/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:38.706417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7469-c398-4817-ad7b-453d56539bc4 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:38.707407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7469-c398-4817-ad7b-453d56539bc4 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:38.708137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7469-c398-4817-ad7b-453d56539bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:38.748853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1fea7469-c398-4817-ad7b-453d56539bc4 None None] MFA Rules not processed for user `8a7779993e0d4691a525b78d1d4ed68a`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:38.750392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1fea7469-c398-4817-ad7b-453d56539bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:38.870270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1112/2208] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:38.902025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:38.907947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:38.994025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:39.110986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64622-8f18-43e3-af90-9b89f9ff9f7a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:39.127065 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:39.131297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:39.131297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:39.131297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:39.310324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:39.311814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:39.337704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1097/2209] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:39.714331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f3b4-265d-423f-a72e-1b1661581f69 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:39.714918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f3b4-265d-423f-a72e-1b1661581f69 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:39.714918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f3b4-265d-423f-a72e-1b1661581f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:39.779966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-71e4f3b4-265d-423f-a72e-1b1661581f69 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:39.781751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-71e4f3b4-265d-423f-a72e-1b1661581f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:39.923809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1113/2210] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:39.937495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:39.938960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:40.064276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492e85-443b-4ef8-8987-c213ead78d02 service glance] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:40.071573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:40.072493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:40.072865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:40.073242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:40.085857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:40.087611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:40.097835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1098/2211] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:58:42.650410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716ce5-b19e-4194-8fa1-c2d2dfb5f264 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:42.651670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716ce5-b19e-4194-8fa1-c2d2dfb5f264 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:42.652084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716ce5-b19e-4194-8fa1-c2d2dfb5f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:42.688396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c8716ce5-b19e-4194-8fa1-c2d2dfb5f264 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:42.689886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c8716ce5-b19e-4194-8fa1-c2d2dfb5f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:42.715402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1114/2212] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:58:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:42.796078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:42.812982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d71522-32cf-4137-85ba-b13c53b4272e service swift] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:42.821506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b950e-ac6b-4465-aa46-adb0d8093c25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:42.822458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b950e-ac6b-4465-aa46-adb0d8093c25 service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:42.822921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b950e-ac6b-4465-aa46-adb0d8093c25 service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:42.823298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b950e-ac6b-4465-aa46-adb0d8093c25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:42.837567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b950e-ac6b-4465-aa46-adb0d8093c25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:42.839553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b950e-ac6b-4465-aa46-adb0d8093c25 service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:42.851010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1099/2213] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 11:58:47.296318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:47.297982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:47.298470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:47.428959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] MFA Rules not processed for user `8612344a6d044a8d9e22f0d0fbef68e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:47.428959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:47.428959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:47.481337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1115/2214] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:52.845643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=76 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:54.243957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa522-1e6d-4669-85be-9df6ab7832a1 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:54.244815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa522-1e6d-4669-85be-9df6ab7832a1 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:54.244815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa522-1e6d-4669-85be-9df6ab7832a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:54.266852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-625fa522-1e6d-4669-85be-9df6ab7832a1 None None] MFA Rules not processed for user `52c0db58ab734bfdb6b4fd46c6e04f13`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:54.268295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-625fa522-1e6d-4669-85be-9df6ab7832a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:54.278201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1100/2215] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:56.762048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:56.763445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:56.867106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fe087-6cce-4687-9cb5-f54331385c61 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:56.885086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:56.886921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:56.886921 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:56.887359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] PATH_INFO: `/v3/users/ca7ef5581cc34e5a8581e5cce1a84f6a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:56.888850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7ef5581cc34e5a8581e5cce1a84f6a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:56.891316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:57.098889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7ef5581cc34e5a8581e5cce1a84f6a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:57.100550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7ef5581cc34e5a8581e5cce1a84f6a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:57.187689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7ef5581cc34e5a8581e5cce1a84f6a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:57.196892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7ef5581cc34e5a8581e5cce1a84f6a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:57.213107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7ef5581cc34e5a8581e5cce1a84f6a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:57.227206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1116/2216] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:56 2022] DELETE /identity/v3/users/ca7ef5581cc34e5a8581e5cce1a84f6a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:57.228621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:57.229121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:57.229201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:57.249388 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:57.250636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:57.326811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1101/2217] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:57.343421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:57.345110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:57.426995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8a3fb-4452-4a51-a4b6-12ebd2c94a5e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:57.432604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3711-d8ff-4d0c-84ad-d7a1f5ebb744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:57.433574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3711-d8ff-4d0c-84ad-d7a1f5ebb744 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:57.433866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3711-d8ff-4d0c-84ad-d7a1f5ebb744 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:57.434165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3711-d8ff-4d0c-84ad-d7a1f5ebb744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:57.447463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b3711-d8ff-4d0c-84ad-d7a1f5ebb744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:57.448985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b3711-d8ff-4d0c-84ad-d7a1f5ebb744 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:57.454347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:57.459991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1117/2218] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:58:57.914893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:57.914893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:57.927611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae6d7-3b2e-4f9e-ab0a-caf51757ca71 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:57.933288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:57.934368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:57.934686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:57.934962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] PATH_INFO: `/v3/projects/b277578391084eaab077199bc3f17f9d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:57.936181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b277578391084eaab077199bc3f17f9d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:57.938093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:58.142199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b277578391084eaab077199bc3f17f9d', 'request_id': 'req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.148258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b277578391084eaab077199bc3f17f9d', 'request_id': 'req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.278452 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b277578391084eaab077199bc3f17f9d', 'request_id': 'req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.291593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] The token cache is being invalidate because project b277578391084eaab077199bc3f17f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:58.292136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.293032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.295170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1102/2219] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:57 2022] DELETE /identity/v3/projects/b277578391084eaab077199bc3f17f9d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:58.299995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c62bc-2e64-4dda-bb23-1f1224ee1b7c None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.300443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c62bc-2e64-4dda-bb23-1f1224ee1b7c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.306812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c62bc-2e64-4dda-bb23-1f1224ee1b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.319217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a11c62bc-2e64-4dda-bb23-1f1224ee1b7c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:58.320525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a11c62bc-2e64-4dda-bb23-1f1224ee1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:58.380812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1118/2220] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:58.383585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:58.385930 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:58.388004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.388300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.388599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.400342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f73b-e7fa-44aa-a3b8-a96e9dbf10a4 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:58.404997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:58.406281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.406281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.406475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] PATH_INFO: `/v3/users/a226f083d0444c45a936b9aa36d86133` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.407704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a226f083d0444c45a936b9aa36d86133)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:58.409627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:58.412143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:58.413479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:58.425704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1119/2221] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:58:58.429880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:58.436460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a530ef-0373-4dd7-a8ea-ad6210e08821 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:58.444006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:58.444826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.445110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.445392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.446120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:58:58.446427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:58.448086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:58.463938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1120/2222] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:58:58.465255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:58.475393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5c7b2-baec-4d8b-a339-c4a5905b2c77 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:58.480911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:58.481550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.481829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.482104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.482821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:58.484746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:58.595382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1121/2223] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:58:58 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:58:58.599495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:58.634069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a226f083d0444c45a936b9aa36d86133'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.634923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a226f083d0444c45a936b9aa36d86133'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.644458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a226f083d0444c45a936b9aa36d86133'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.680287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5739f-5799-45f6-8ccc-5fe950ade805 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:58.685552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:58.686064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.686343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.686832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.687631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:58.690365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:58.718217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a226f083d0444c45a936b9aa36d86133'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.726289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:58.732099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a226f083d0444c45a936b9aa36d86133'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:58.738009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1103/2224] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:58 2022] DELETE /identity/v3/users/a226f083d0444c45a936b9aa36d86133 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:58.820351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1122/2225] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:58:58 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:58:58.824442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:58.825979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:58.953229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6634af8-5335-444d-8390-2b851126e996 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:58.958213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:58.958945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:58.959266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:58.959495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:58.960239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:58.962085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:58.977752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1104/2226] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:58.978822 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:58.991687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201737c-e143-4131-bf67-7359b65715ac admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:59.005739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:59.007716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:59.008391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:59.008542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:59.008748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:59.009189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:59.010686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:59.016567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:59.025075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4216c-e06d-4338-aeb6-fb0e0f06b146 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:59.044830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:59.046150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:59.046670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:59.051739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] PATH_INFO: `/v3/projects/e22a37c386a94573b25144ee3cba184d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:59.051739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22a37c386a94573b25144ee3cba184d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:59.051739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:59.057312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1123/2227] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:58:59.057924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:59.068613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475cba-cb2b-4f13-917a-dc602b4ce9c4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:59.074827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21292e-f429-4199-97fc-887ab1af7276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:59.075766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21292e-f429-4199-97fc-887ab1af7276 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:59.076098 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21292e-f429-4199-97fc-887ab1af7276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:59.076376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21292e-f429-4199-97fc-887ab1af7276 admin admin] PATH_INFO: `/v3/projects/b24a383840724b448c5455a764997f5e/users/a3bd8039bba846b2bc6a0d62063e8b06/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:59.096517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21292e-f429-4199-97fc-887ab1af7276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a383840724b448c5455a764997f5e, user_id=a3bd8039bba846b2bc6a0d62063e8b06, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:59.101062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21292e-f429-4199-97fc-887ab1af7276 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:59.201254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1124/2228] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:58:59 2022] PUT /identity/v3/projects/b24a383840724b448c5455a764997f5e/users/a3bd8039bba846b2bc6a0d62063e8b06/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:58:59.205645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:59.205940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:59.206223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:59.209980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22a37c386a94573b25144ee3cba184d', 'request_id': 'req-5059a482-7e9e-4296-96a9-5fd8920fc916'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.224428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22a37c386a94573b25144ee3cba184d', 'request_id': 'req-5059a482-7e9e-4296-96a9-5fd8920fc916'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.245509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:59.260714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] MFA Rules not processed for user `a3bd8039bba846b2bc6a0d62063e8b06`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:58:59.262101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:59.335800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22a37c386a94573b25144ee3cba184d', 'request_id': 'req-5059a482-7e9e-4296-96a9-5fd8920fc916'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.341861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1125/2229] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:58:59.349849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] The token cache is being invalidate because project e22a37c386a94573b25144ee3cba184d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:58:59.350150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.350828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.352608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1105/2230] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:58:59 2022] DELETE /identity/v3/projects/e22a37c386a94573b25144ee3cba184d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:58:59.354484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:59.356076 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:59.356434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:58:59.359432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:59.431090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059a482-7e9e-4296-96a9-5fd8920fc916 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:59.435851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:59.436727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:59.437007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:59.437284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] PATH_INFO: `/v3/users/313b2f3804d64682a55670bdc2b0a325` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:59.438489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313b2f3804d64682a55670bdc2b0a325)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:59.440440 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:59.441496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db427c19-dcdb-4e92-9ec0-cacd052d4294 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:58:59.446023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:58:59.446683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:58:59.446968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:58:59.447245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:58:59.449159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:58:59.452456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:58:59.461447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:58:59.463020 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:58:59.472355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1126/2231] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:58:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:58:59.610105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313b2f3804d64682a55670bdc2b0a325'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.611105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313b2f3804d64682a55670bdc2b0a325'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.622236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313b2f3804d64682a55670bdc2b0a325'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.701647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313b2f3804d64682a55670bdc2b0a325'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.716356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3052fb14-4c00-4247-b95e-19fcaee92f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313b2f3804d64682a55670bdc2b0a325'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:58:59.724010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1106/2232] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:58:59 2022] DELETE /identity/v3/users/313b2f3804d64682a55670bdc2b0a325 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:00.029589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.043866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d497da3-b6b6-4c00-abef-1ce2f008ff61 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.107161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.109236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.109236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.109236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] PATH_INFO: `/v3/projects/d694686339e04b61a600e2e30dead7c1` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.109818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d694686339e04b61a600e2e30dead7c1)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:00.111767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:00.212528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:00.228878 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd694686339e04b61a600e2e30dead7c1', 'request_id': 'req-8a10abdf-5a35-41a5-b8ed-af870691577e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:00.234375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd694686339e04b61a600e2e30dead7c1', 'request_id': 'req-8a10abdf-5a35-41a5-b8ed-af870691577e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:00.380973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd694686339e04b61a600e2e30dead7c1', 'request_id': 'req-8a10abdf-5a35-41a5-b8ed-af870691577e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:00.401687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] The token cache is being invalidate because project d694686339e04b61a600e2e30dead7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:59:00.401982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:00.402818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8a10abdf-5a35-41a5-b8ed-af870691577e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:00.404386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1127/2233] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:59:00 2022] DELETE /identity/v3/projects/d694686339e04b61a600e2e30dead7c1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:00.410143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.410689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.410788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.428433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:00.430202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:00.495218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1107/2234] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:00.502804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.503118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.503392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.521517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:00.525801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:00.531006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1128/2235] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:00.535109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.545026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b787-fd32-4cff-ae50-06b1a5214ddc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.549724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.550374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.550691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.550970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.551694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:59:00.552002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:00.553827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:00.565967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1108/2236] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:59:00.570150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.579302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b93b4-3c0f-43f2-9789-0475f8052427 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.583941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.584578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.584862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.585140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.585831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:00.587786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:00.707438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1129/2237] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:59:00 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:59:00.711940 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.721896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993414-f97e-439d-8b85-f6a3add36f1d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.778446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.779260 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.779549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.779834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.780512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:00.782414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:00.891503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1109/2238] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:59:00 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:59:00.895361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.906350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388dbc-9cef-46ef-8306-5531820ee143 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.911124 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.914034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.914034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.914034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.914034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:00.915341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:00.932177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1130/2239] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:59:00.933853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.943747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:00.948290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61677973-fdbd-4115-8e71-93d6a8268cd3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.955763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83849bb-c9a2-484e-8bc6-288605f1a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.956436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83849bb-c9a2-484e-8bc6-288605f1a5af admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.956702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83849bb-c9a2-484e-8bc6-288605f1a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:00.956976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83849bb-c9a2-484e-8bc6-288605f1a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:00.957709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83849bb-c9a2-484e-8bc6-288605f1a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:00.962703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83849bb-c9a2-484e-8bc6-288605f1a5af admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:00.971946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1110/2240] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:59:00.977196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:00.987420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce2235-2f08-4dad-b92f-23edfcb47f10 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:00.993430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6329ba8-e29a-456d-919c-ff916c349546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:00.994142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6329ba8-e29a-456d-919c-ff916c349546 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:00.994425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6329ba8-e29a-456d-919c-ff916c349546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:01.014224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6329ba8-e29a-456d-919c-ff916c349546 admin admin] PATH_INFO: `/v3/projects/0593a6cfbaba402490e95f6f3898e373/users/84ba9b98ae334c3f9d8cc50d5766afd8/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:01.023017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6329ba8-e29a-456d-919c-ff916c349546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0593a6cfbaba402490e95f6f3898e373, user_id=84ba9b98ae334c3f9d8cc50d5766afd8, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:01.026311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6329ba8-e29a-456d-919c-ff916c349546 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:01.099095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:01.099478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:01.099810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:01.130392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1131/2241] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:59:00 2022] PUT /identity/v3/projects/0593a6cfbaba402490e95f6f3898e373/users/84ba9b98ae334c3f9d8cc50d5766afd8/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:59:01.141695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:01.141990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:01.142269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:01.153098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:01.154538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:01.198182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] MFA Rules not processed for user `84ba9b98ae334c3f9d8cc50d5766afd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:01.199782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:01.244600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1111/2242] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:01.259779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:01.261539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:01.310618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1132/2243] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:01.324075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:01.327855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:01.404986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1ea4-2dda-4dd2-a63e-84c7902c7369 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:01.414511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:01.417882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:01.418138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:01.418812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:01.423636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:01.438562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:01.439370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd1f95-e5e0-4684-b510-db68ee2c1ab7 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:01.441352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:01.444306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70386463-41c4-4a31-a24b-1e5fc1293734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:01.445027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70386463-41c4-4a31-a24b-1e5fc1293734 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:01.445924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70386463-41c4-4a31-a24b-1e5fc1293734 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:01.446265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70386463-41c4-4a31-a24b-1e5fc1293734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:01.454331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1112/2244] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 11:59:01.456307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70386463-41c4-4a31-a24b-1e5fc1293734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:01.457773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70386463-41c4-4a31-a24b-1e5fc1293734 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:01.469572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1133/2245] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:59:02.826401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:02.828577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:02.952600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:03.010708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6e47-eb50-4ce3-93f6-046f0b55c499 service swift] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:03.017885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:03.020695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:03.021550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:03.022181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] PATH_INFO: `/v3/users/a3bd8039bba846b2bc6a0d62063e8b06` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:03.024281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bd8039bba846b2bc6a0d62063e8b06)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:03.026433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:03.359057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bd8039bba846b2bc6a0d62063e8b06'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:03.362152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bd8039bba846b2bc6a0d62063e8b06'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:03.388400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bd8039bba846b2bc6a0d62063e8b06'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:03.484277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bd8039bba846b2bc6a0d62063e8b06'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:03.503741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bd8039bba846b2bc6a0d62063e8b06'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:03.510455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1113/2246] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:59:02 2022] DELETE /identity/v3/users/a3bd8039bba846b2bc6a0d62063e8b06 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:03.515234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d823c7-9601-422d-9438-a9b15fbaec62 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:03.516351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d823c7-9601-422d-9438-a9b15fbaec62 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:03.516939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d823c7-9601-422d-9438-a9b15fbaec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:03.541685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-51d823c7-9601-422d-9438-a9b15fbaec62 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:03.543156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-51d823c7-9601-422d-9438-a9b15fbaec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:03.703631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1134/2247] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:03.717671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:03.720229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:03.849851 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d19b-3aa5-4fbd-a6d2-24cd1fa979fd admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:03.857221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593174-d0fe-4eac-a841-e27638351eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:03.857221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593174-d0fe-4eac-a841-e27638351eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:03.857221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593174-d0fe-4eac-a841-e27638351eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:03.857221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593174-d0fe-4eac-a841-e27638351eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:03.872877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd593174-d0fe-4eac-a841-e27638351eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:03.874340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd593174-d0fe-4eac-a841-e27638351eb3 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:03.901839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1114/2248] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:04.494332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7d0c-8e2e-4513-b251-892fc6939854 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:04.494667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7d0c-8e2e-4513-b251-892fc6939854 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:04.495013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7d0c-8e2e-4513-b251-892fc6939854 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:04.497759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1135/2249] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:59:04.524850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:04.525510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:04.525986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:04.629338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:04.630975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:04.705482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:04.819049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1115/2250] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:04.830942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7d0c-8e2e-4513-b251-892fc6939854 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:04.834004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-145b7d0c-8e2e-4513-b251-892fc6939854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:04.936295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7d0c-8e2e-4513-b251-892fc6939854 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:04.940647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160ca7-f475-40a2-97e2-52a90387fb73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:04.941366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160ca7-f475-40a2-97e2-52a90387fb73 service glance] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:04.942192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160ca7-f475-40a2-97e2-52a90387fb73 service glance] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:04.942192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160ca7-f475-40a2-97e2-52a90387fb73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:04.954391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3160ca7-f475-40a2-97e2-52a90387fb73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:04.956018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3160ca7-f475-40a2-97e2-52a90387fb73 service glance] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:04.968719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1136/2251] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:05.039784 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.042016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:05.058567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd862c4e-0443-484b-a6a2-1cfe87a25959 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.065469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.066903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.067441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.067787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] PATH_INFO: `/v3/projects/b24a383840724b448c5455a764997f5e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.069026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24a383840724b448c5455a764997f5e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.071631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.211493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24a383840724b448c5455a764997f5e', 'request_id': 'req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:05.216542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c15f-1695-42f8-a218-794b1ff6fdcd None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.216914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c15f-1695-42f8-a218-794b1ff6fdcd None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.217199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c15f-1695-42f8-a218-794b1ff6fdcd None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.217519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24a383840724b448c5455a764997f5e', 'request_id': 'req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:05.218600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1137/2252] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 11:59:05.224528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.224887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.225188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.243332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:05.244538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:05.294614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1138/2253] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:05.306852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.312249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24a383840724b448c5455a764997f5e', 'request_id': 'req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:05.315389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7e1f-6870-48e1-a8bc-277df1f3b8fe None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.319238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9283eb-39e3-4b12-b18c-d1f1c234c8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.319947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9283eb-39e3-4b12-b18c-d1f1c234c8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.320201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9283eb-39e3-4b12-b18c-d1f1c234c8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.320989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9283eb-39e3-4b12-b18c-d1f1c234c8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.325050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] The token cache is being invalidate because project b24a383840724b448c5455a764997f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:59:05.325379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:05.326083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f313ac4b-6dc9-4e06-88e7-29f6a3cb6ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:05.327740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1116/2254] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:59:05 2022] DELETE /identity/v3/projects/b24a383840724b448c5455a764997f5e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:05.328708 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9283eb-39e3-4b12-b18c-d1f1c234c8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.330206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9283eb-39e3-4b12-b18c-d1f1c234c8a5 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.332402 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b683c9f-7acd-434b-a561-b45a188da445 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.332689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b683c9f-7acd-434b-a561-b45a188da445 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.333707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b683c9f-7acd-434b-a561-b45a188da445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.339115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1139/2255] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:59:05.353825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3b683c9f-7acd-434b-a561-b45a188da445 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:05.355094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3b683c9f-7acd-434b-a561-b45a188da445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:05.430170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1117/2256] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:05.438830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.439129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.440278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.448283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:05.459874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:05.461130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:05.472254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aab249-3f6a-450c-b61a-f7e2d7bf732f None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.472254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aab249-3f6a-450c-b61a-f7e2d7bf732f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.472254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aab249-3f6a-450c-b61a-f7e2d7bf732f None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.472254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1118/2257] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 11:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 11:59:05.473423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1140/2258] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:05.474824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.475115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.475400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.477270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.486779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bab29-c115-4e92-930a-f0b3ca3f747f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.491646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.492885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.493172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.493448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.494236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:59:05.494545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.495033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:05.496643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:05.496757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.513329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1141/2259] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 11:59:05.514220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.526087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eb8b5-4760-460c-8c0b-c3a607afafda admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.531134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.531797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.532143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.532449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.533149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.535327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.540291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:05.574074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1119/2260] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:05.584526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.585926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:05.597934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecef0d0-2a92-4c1b-85b0-bd1af153811a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.602443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.603103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.603387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.603665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.613828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.615359 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.628242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1120/2261] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 11:59:05.648660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1142/2262] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:59:05 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:59:05.653082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.665616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c370-71da-48f6-ba16-cb3efffeb9ec service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.779993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.781015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.781632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.782387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.783505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.787821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.879022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1121/2263] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:59:05 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 11:59:05.885397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.897514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81b05-a9c9-4d60-81af-c6ae3bf8ebb1 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.902987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.903746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.903927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.904205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.904935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.906531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.917901 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1143/2264] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:59:05.922067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.933610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5b01-e1de-4610-9307-518aecc7d31d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:05.945539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445befb-cec2-48b6-995f-a52d198461b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:05.946311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445befb-cec2-48b6-995f-a52d198461b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:05.946702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445befb-cec2-48b6-995f-a52d198461b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:05.947048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445befb-cec2-48b6-995f-a52d198461b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:05.947860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445befb-cec2-48b6-995f-a52d198461b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:05.951175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445befb-cec2-48b6-995f-a52d198461b1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:05.979752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1122/2265] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:59:05.981366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:05.995463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc796dc-bb28-4983-8bbb-f5279d08ad9e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:06.001645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:06.002614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:06.002930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:06.003217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] PATH_INFO: `/v3/projects/da9078a33d7e4d4bad5af0afd344637e/users/fa261923a5b34613ac92086f5d31161c/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:06.024918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9078a33d7e4d4bad5af0afd344637e, user_id=fa261923a5b34613ac92086f5d31161c, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:06.028096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:06.098085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1144/2266] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:59:05 2022] PUT /identity/v3/projects/da9078a33d7e4d4bad5af0afd344637e/users/fa261923a5b34613ac92086f5d31161c/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 11:59:06.109826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:06.110363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:06.110868 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:06.178086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] MFA Rules not processed for user `fa261923a5b34613ac92086f5d31161c`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:06.179362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:06.294640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1123/2267] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:06.306292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:06.308349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:06.375757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcecfa-9e8e-41dc-b343-6222040e73f4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:06.379790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282fccc-6a3c-485c-9481-077a6db9edea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:06.380481 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282fccc-6a3c-485c-9481-077a6db9edea service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:06.380769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282fccc-6a3c-485c-9481-077a6db9edea service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:06.381078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282fccc-6a3c-485c-9481-077a6db9edea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:06.390461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282fccc-6a3c-485c-9481-077a6db9edea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:06.391949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282fccc-6a3c-485c-9481-077a6db9edea service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:06.409177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1145/2268] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:16.291350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:16.397165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:16.693297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:16.695328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:16.803587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f840e4-ad96-426d-9bbc-dc993625d89d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:16.809711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:16.811545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:16.812005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:16.812418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:16.814960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:16.833592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:16.837367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:16.847463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1124/2269] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:19.234370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:19.234884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:19.234983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:19.256933 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:19.258194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:19.324241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1146/2270] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 11:59:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:19.350562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:19.353699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:19.440666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414b231-ee2c-46f9-ae6e-94152a7250f4 service placement] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:19.448083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38612be-daca-4313-ade1-4f7cc6a839ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:19.448957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38612be-daca-4313-ade1-4f7cc6a839ee service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:19.449268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38612be-daca-4313-ade1-4f7cc6a839ee service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:19.449720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38612be-daca-4313-ade1-4f7cc6a839ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:19.462211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38612be-daca-4313-ade1-4f7cc6a839ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:19.464278 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38612be-daca-4313-ade1-4f7cc6a839ee service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:19.476183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1125/2271] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:59:19.698109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:19.848297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e3d09-c2dc-45a2-869f-f1a77f0c9033 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:19.867429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:19.868322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:19.868602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:19.868883 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] PATH_INFO: `/v3/users/fa261923a5b34613ac92086f5d31161c` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:19.873087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa261923a5b34613ac92086f5d31161c)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:19.875338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:20.636350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa261923a5b34613ac92086f5d31161c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:20.639103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa261923a5b34613ac92086f5d31161c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:20.724231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa261923a5b34613ac92086f5d31161c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:20.739721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa261923a5b34613ac92086f5d31161c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:20.771180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa261923a5b34613ac92086f5d31161c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:20.788614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1147/2272] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:59:19 2022] DELETE /identity/v3/users/fa261923a5b34613ac92086f5d31161c => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:20.794317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:20.795007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:20.795007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:20.826017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:20.828389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:20.920812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:20.938899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1126/2273] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:20.944863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:20.946372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:21.000755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:21.063866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3e864-afad-4270-8106-618c4bb32168 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:21.072732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c1c0-bbb9-4cd7-81ef-9e409544c512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:21.074073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c1c0-bbb9-4cd7-81ef-9e409544c512 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:21.074974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c1c0-bbb9-4cd7-81ef-9e409544c512 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:21.075513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c1c0-bbb9-4cd7-81ef-9e409544c512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:21.092193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c1c0-bbb9-4cd7-81ef-9e409544c512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:21.095398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c1c0-bbb9-4cd7-81ef-9e409544c512 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:21.110643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1148/2274] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:21.905593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:21.907188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:21.927054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282639d-838b-46dd-9e69-63b1e968ef67 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:21.946399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:21.947399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:21.947762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:21.948061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] PATH_INFO: `/v3/projects/da9078a33d7e4d4bad5af0afd344637e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:21.950358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9078a33d7e4d4bad5af0afd344637e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:21.952519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:22.098166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9078a33d7e4d4bad5af0afd344637e', 'request_id': 'req-da9d17d7-05f0-4461-8642-8cc3a84a12b7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:22.105739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9078a33d7e4d4bad5af0afd344637e', 'request_id': 'req-da9d17d7-05f0-4461-8642-8cc3a84a12b7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:22.198644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9078a33d7e4d4bad5af0afd344637e', 'request_id': 'req-da9d17d7-05f0-4461-8642-8cc3a84a12b7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:22.212529 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] The token cache is being invalidate because project da9078a33d7e4d4bad5af0afd344637e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:59:22.212991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:22.214005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:22.216650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1127/2275] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:59:21 2022] DELETE /identity/v3/projects/da9078a33d7e4d4bad5af0afd344637e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:31.134350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=15 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:32.209534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:40.739779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:40.740349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:40.740594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:40.758108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:40.759537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:40.817517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1149/2276] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jun 16 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:40.833870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:40.834372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:40.835497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:40.835605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:40.914927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489b98-4709-435e-b5d1-6814f14429ce None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:40.921003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:40.921966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:40.922326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:40.922522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d17d7-05f0-4461-8642-8cc3a84a12b7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:40.922695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] PATH_INFO: `/v3/users/84ba9b98ae334c3f9d8cc50d5766afd8` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:40.923830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ba9b98ae334c3f9d8cc50d5766afd8)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:40.925757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:40.928549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359798-6b1a-4e84-927e-a9b5e11d145d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:40.929538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359798-6b1a-4e84-927e-a9b5e11d145d service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:40.929992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359798-6b1a-4e84-927e-a9b5e11d145d service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:40.930545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359798-6b1a-4e84-927e-a9b5e11d145d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:40.940206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73359798-6b1a-4e84-927e-a9b5e11d145d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:40.941796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73359798-6b1a-4e84-927e-a9b5e11d145d service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:40.950634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1128/2277] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 11:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 11:59:41.104023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ba9b98ae334c3f9d8cc50d5766afd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:41.104713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ba9b98ae334c3f9d8cc50d5766afd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:41.186786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ba9b98ae334c3f9d8cc50d5766afd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:41.194431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ba9b98ae334c3f9d8cc50d5766afd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:41.207209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ba9b98ae334c3f9d8cc50d5766afd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:41.214871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1150/2278] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:59:40 2022] DELETE /identity/v3/users/84ba9b98ae334c3f9d8cc50d5766afd8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:41.219343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:41.219641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:41.219928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:41.237892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:41.239131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:41.303410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1129/2279] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:41.310393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:41.311981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:41.341113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:41.373422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a12d-a088-4562-b13a-d636f39f823b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:41.377324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498410-f21d-4f21-bd2d-e11e64202967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:41.377975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498410-f21d-4f21-bd2d-e11e64202967 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:41.378264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498410-f21d-4f21-bd2d-e11e64202967 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:41.378693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498410-f21d-4f21-bd2d-e11e64202967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:41.390406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498410-f21d-4f21-bd2d-e11e64202967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:41.392022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498410-f21d-4f21-bd2d-e11e64202967 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:41.404163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1151/2280] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:41.891584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:41.893261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:41.912444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49695b-0b91-4fed-8d1c-0cef48923acf None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:41.914961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:41.916142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:41.916675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:41.917163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] PATH_INFO: `/v3/projects/0593a6cfbaba402490e95f6f3898e373` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:41.918738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0593a6cfbaba402490e95f6f3898e373)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:41.920967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.067458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0593a6cfbaba402490e95f6f3898e373', 'request_id': 'req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:42.073871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0593a6cfbaba402490e95f6f3898e373', 'request_id': 'req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:42.167927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0593a6cfbaba402490e95f6f3898e373', 'request_id': 'req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:42.180210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] The token cache is being invalidate because project 0593a6cfbaba402490e95f6f3898e373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:59:42.180577 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:42.181252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-7ca5e4d5-1d80-48ef-aa00-57a53b5a13f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:42.183100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1130/2281] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:59:41 2022] DELETE /identity/v3/projects/0593a6cfbaba402490e95f6f3898e373 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:42.187867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.188386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.188486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.209155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:42.210368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:42.274859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1152/2282] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 11:59:42.282673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.282966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.283356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.301777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:42.303021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:42.312627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1131/2283] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:42.316912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.327246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8752755-3c02-4e38-beca-071bd116b012 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:42.332905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:42.334574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.334892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.335169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.335908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 11:59:42.336220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:42.337917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.350981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1153/2284] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 11:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 11:59:42.355276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.364703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfc898-1317-424d-b8c3-12a461175d10 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:42.369561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:42.370770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.371049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.371319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.372041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:42.374005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.377337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:42.464658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1132/2285] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 11:59:42 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:59:42.467971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.478217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc123-be7a-43f2-b27b-5d4ddc7eb91b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:42.533138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:42.533803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.534082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.534354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.535086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:42.537009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.642483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1154/2286] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 11:59:42 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 11:59:42.647154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.661341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406d7a-f0c2-43e7-b53c-ed1bba321ee7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:42.675489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:42.676372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.676670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.676947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.677684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:42.680610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.696317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1133/2287] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 11:59:42.700669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.711593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5104-ef69-431a-93ef-9ae014f43167 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:42.718276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a26e-b5e4-4fb6-8c8c-1378607395d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:42.718910 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a26e-b5e4-4fb6-8c8c-1378607395d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.719198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a26e-b5e4-4fb6-8c8c-1378607395d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.719513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a26e-b5e4-4fb6-8c8c-1378607395d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.720204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a26e-b5e4-4fb6-8c8c-1378607395d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:42.735562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a26e-b5e4-4fb6-8c8c-1378607395d8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.735562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1155/2288] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 11:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 11:59:42.738476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.749671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5611-ba2f-47b9-b409-825083109084 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:42.756978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:42.760049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.760049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.760049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] PATH_INFO: `/v3/projects/91bacd6ae78548d7acb756d6aa24b955/users/70d679bca419419f8a7784f6d0ec56d7/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.773038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bacd6ae78548d7acb756d6aa24b955, user_id=70d679bca419419f8a7784f6d0ec56d7, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:42.775767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:42.845501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1134/2289] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 11:59:42 2022] PUT /identity/v3/projects/91bacd6ae78548d7acb756d6aa24b955/users/70d679bca419419f8a7784f6d0ec56d7/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:42.856404 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:42.856701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:42.857018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:42.883172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] MFA Rules not processed for user `70d679bca419419f8a7784f6d0ec56d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:42.886179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:42.905400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:42.952652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1156/2290] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:42.964831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:42.966730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:43.026865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e7dc-df5b-4013-8672-7d1ddad6b7c0 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:43.030707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:43.031379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:43.031666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:43.031942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:43.040465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:43.042046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:43.051069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1135/2291] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:46.259058 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:46.260564 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:46.321877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d873e-e4d0-4e85-93f7-0357e601cc62 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:46.326718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:46.327843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:46.327843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:46.328179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:46.330104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:46.396821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:46.399139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6386b-b556-46c6-ab3e-22ac59aff740 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:46.409980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1157/2292] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:48.992755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:49.095279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a403d-7281-474f-bee2-8183183aa4ac service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:49.100872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:49.101763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:49.102045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:49.102318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] PATH_INFO: `/v3/users/70d679bca419419f8a7784f6d0ec56d7` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:49.103684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d679bca419419f8a7784f6d0ec56d7)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:49.106046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:49.303720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d679bca419419f8a7784f6d0ec56d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:49.304380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d679bca419419f8a7784f6d0ec56d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:49.310446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:49.312474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d679bca419419f8a7784f6d0ec56d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:49.387178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d679bca419419f8a7784f6d0ec56d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:49.410606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d679bca419419f8a7784f6d0ec56d7'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:49.417960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1136/2293] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 11:59:48 2022] DELETE /identity/v3/users/70d679bca419419f8a7784f6d0ec56d7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:49.423537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:49.424359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:49.424645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:49.442812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:49.444299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:49.534923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1158/2294] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 11:59:49.547791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:49.550835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:49.638266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5fe41-4559-4ef4-b69a-c32db55b0d64 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:49.642551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4e60-91ce-4176-a40f-9be42bbffb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:49.643592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4e60-91ce-4176-a40f-9be42bbffb14 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:49.643955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4e60-91ce-4176-a40f-9be42bbffb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:49.644312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4e60-91ce-4176-a40f-9be42bbffb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:49.656884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4e60-91ce-4176-a40f-9be42bbffb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:49.658482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4e60-91ce-4176-a40f-9be42bbffb14 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:49.672410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1137/2295] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 11:59:50.386596 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 11:59:50.388175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:50.401484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b935b-4fcd-4da3-8b30-d9588d673af0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 11:59:50.406991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 11:59:50.407869 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:50.408207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:50.408491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] PATH_INFO: `/v3/projects/91bacd6ae78548d7acb756d6aa24b955` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:50.409771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bacd6ae78548d7acb756d6aa24b955)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 11:59:50.411794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 11:59:50.420510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 11:59:50.552531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bacd6ae78548d7acb756d6aa24b955', 'request_id': 'req-50a058ee-fd97-4b00-92dc-092110a84808'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:50.558050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bacd6ae78548d7acb756d6aa24b955', 'request_id': 'req-50a058ee-fd97-4b00-92dc-092110a84808'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:50.649212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bacd6ae78548d7acb756d6aa24b955', 'request_id': 'req-50a058ee-fd97-4b00-92dc-092110a84808'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:50.663999 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] The token cache is being invalidate because project 91bacd6ae78548d7acb756d6aa24b955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 11:59:50.664295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:50.665028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-50a058ee-fd97-4b00-92dc-092110a84808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 11:59:50.666769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1159/2296] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 11:59:50 2022] DELETE /identity/v3/projects/91bacd6ae78548d7acb756d6aa24b955 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 11:59:51.753253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c1f74-c0cb-4491-97ab-b6069d645d65 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 11:59:51.753732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c1f74-c0cb-4491-97ab-b6069d645d65 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 11:59:51.754124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c1f74-c0cb-4491-97ab-b6069d645d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 11:59:51.770958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1f5c1f74-c0cb-4491-97ab-b6069d645d65 None None] MFA Rules not processed for user `daeda01f27034ddcafe45bd8f7d15a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 11:59:51.772202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1f5c1f74-c0cb-4491-97ab-b6069d645d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 11:59:51.829526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1138/2297] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:00:00.746525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:01.823496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=60,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:28.360234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc575-1ef7-49f0-b67a-53a1bdc0afb8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:00:28.360757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc575-1ef7-49f0-b67a-53a1bdc0afb8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:00:28.360854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc575-1ef7-49f0-b67a-53a1bdc0afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:00:28.377785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dfbfc575-1ef7-49f0-b67a-53a1bdc0afb8 None None] MFA Rules not processed for user `8612344a6d044a8d9e22f0d0fbef68e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:00:28.378998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dfbfc575-1ef7-49f0-b67a-53a1bdc0afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:00:28.430339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1160/2298] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:00:38.423623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=25 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:39.932223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6526f-487c-47af-ac52-ae8a6aac25ae None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:00:39.932758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6526f-487c-47af-ac52-ae8a6aac25ae None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:00:39.933027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6526f-487c-47af-ac52-ae8a6aac25ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:00:39.953169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-cad6526f-487c-47af-ac52-ae8a6aac25ae None None] MFA Rules not processed for user `3cf5430244c340f6988b3a9ebca9d777`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:00:39.954687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cad6526f-487c-47af-ac52-ae8a6aac25ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:00:40.015714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1139/2299] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:00:42.573429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:00:42.573957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:00:42.573957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:00:42.592537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] MFA Rules not processed for user `d3b2fff3179d40c58d41c1bb422454f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:00:42.594085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:00:42.659387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1161/2300] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:00:50.008782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=25 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:00:52.647641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=25 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:06.135705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:06.136273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:06.136273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:06.155579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] MFA Rules not processed for user `daeda01f27034ddcafe45bd8f7d15a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:06.156780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:06.164075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1140/2301] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:14.842322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:14.843817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:14.906774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2a366-8fff-4c96-bcd0-f4083fa5451a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:14.910443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:14.911271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:14.911691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:14.911967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:14.913748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:14.984549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:14.985913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:14.996872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1162/2302] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:15.222599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:15.233524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf95e87-c045-4743-83bb-9b6d83015abc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:15.237315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:15.237854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:15.238134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:15.238428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:15.240204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:15.254314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:15.260285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:15.266848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1141/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:24.992005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=54 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:25.261852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=9 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:32.030442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:32.032137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:32.045897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12127b-21fc-493b-bbad-45f1b18ee827 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:32.051450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:32.052073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:32.052355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:32.052631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:32.054449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:32.065089 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:32.066683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:32.075551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1163/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:36.853928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:36.863250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899021ff-2224-48c1-966c-141f2a45594f service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:36.867193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:36.868033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:36.868229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:36.868506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:36.870281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:36.949088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:36.949927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:36.960590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1142/2305] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:39.206327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:39.207861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:39.222133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a4833-3b22-4883-aaeb-2af0c8de4113 service nova] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:39.228200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:39.228868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:39.229152 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:39.229430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:39.231208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:39.242238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:39.243769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:39.253285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1164/2306] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:40.903284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:40.904712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:40.917951 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46c81-084f-4188-b61d-affecb3d9bdf service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:40.922961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:40.923831 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:40.924112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:40.924514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] PATH_INFO: `/v3/users/8612344a6d044a8d9e22f0d0fbef68e1` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:40.925708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8612344a6d044a8d9e22f0d0fbef68e1)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:40.928045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:41.138572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8612344a6d044a8d9e22f0d0fbef68e1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.139619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8612344a6d044a8d9e22f0d0fbef68e1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.147504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8612344a6d044a8d9e22f0d0fbef68e1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.248281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8612344a6d044a8d9e22f0d0fbef68e1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.261689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-004636b1-c9e5-4e95-ae55-983fdd0fc0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8612344a6d044a8d9e22f0d0fbef68e1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.268857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1143/2307] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:01:40 2022] DELETE /identity/v3/users/8612344a6d044a8d9e22f0d0fbef68e1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:41.592683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:41.603716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64ff2-40c5-4c01-bf62-12c483d08d6f service nova] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:41.664439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:41.665310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:41.665591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:41.665870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] PATH_INFO: `/v3/projects/e3cf25b3a33743ffba05876b495bd2c7` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:41.667339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cf25b3a33743ffba05876b495bd2c7)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:41.669330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:41.787988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cf25b3a33743ffba05876b495bd2c7', 'request_id': 'req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.793723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cf25b3a33743ffba05876b495bd2c7', 'request_id': 'req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.876646 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cf25b3a33743ffba05876b495bd2c7', 'request_id': 'req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.888950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] The token cache is being invalidate because project e3cf25b3a33743ffba05876b495bd2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:01:41.889691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.889849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9cb2d20b-74d1-4373-b7b8-c47d4b32231f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:41.891557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1165/2308] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:01:41 2022] DELETE /identity/v3/projects/e3cf25b3a33743ffba05876b495bd2c7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:01:41.896410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:41.896749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:41.897033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:41.914897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:41.916100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:41.974875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1144/2309] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:41.982700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:41.983017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:41.983326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.001833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:42.003069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:42.010917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1166/2310] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:42.015011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.024680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d8dc7-9196-4fc1-887b-333e278e847d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.028931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.029572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.029853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.030131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.031416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:01:42.031722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.033301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.034766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:42.045027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1145/2311] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:01:42.049698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.059000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2c669-f581-4298-98f2-70fd98f0b37e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.064112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.070543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.070543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.070543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.070543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.070543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.162158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1167/2312] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:01:42 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:01:42.165846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.177777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75793b-d010-4b5b-a060-af8d4f8b225a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.236243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.236901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.237184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.237454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.238142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.240070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.363063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1146/2313] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:01:42 2022] POST /identity/v3/users => generated 279 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:01:42.366812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.377477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fb2d0-0f44-4548-aa31-0713a1b694b8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.384693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.384693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.384693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.384693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.385102 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.386795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.398423 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1168/2314] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:01:42.402495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.415149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd34d1-bcd2-4b75-9f26-fc490234308b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.422473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.423113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.423401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.426455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.428323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.430432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.446607 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1147/2315] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:01:42.447871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.458949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4440d7-6b9d-44a9-a83e-1c6f656f69a8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.463558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbd742-8a23-4fb0-aef2-2387abd34fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.464438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbd742-8a23-4fb0-aef2-2387abd34fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.464724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbd742-8a23-4fb0-aef2-2387abd34fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.465057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbd742-8a23-4fb0-aef2-2387abd34fe8 admin admin] PATH_INFO: `/v3/projects/caa7c5dd28ab43db99246107e2b5142d/users/8cde124903bc4b6aa5bb1f089d7b9da1/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.483349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbd742-8a23-4fb0-aef2-2387abd34fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa7c5dd28ab43db99246107e2b5142d, user_id=8cde124903bc4b6aa5bb1f089d7b9da1, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.489843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbd742-8a23-4fb0-aef2-2387abd34fe8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.541555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.543403 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:42.584640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:42.589821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1169/2316] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:01:42 2022] PUT /identity/v3/projects/caa7c5dd28ab43db99246107e2b5142d/users/8cde124903bc4b6aa5bb1f089d7b9da1/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:42.599938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.600922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.600922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.621600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9693237-6369-4e3e-868f-e22c92da8e2a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.626312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] MFA Rules not processed for user `8cde124903bc4b6aa5bb1f089d7b9da1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:42.627985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:42.687821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.688375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.688658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.688935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.690943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:42.692336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1170/2317] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:01:42.696817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.700220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:42.752826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.754459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.758137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7af3a-9d79-4eb9-a7cc-1686a7d875b3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.762838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.763500 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.764049 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.764166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1148/2318] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:01:42.764295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.764743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.767258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:42.863230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1171/2319] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:01:42 2022] POST /identity/v3/projects => generated 357 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:01:42.864516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:42.875500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4db1-9e67-4cf0-982a-fa464bc4aa51 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:42.934497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:42.935184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:42.935466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:42.935739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:42.936415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:42.939054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.054753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1149/2320] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:01:42 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:01:43.058466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.069321 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa691c-b93b-461d-9edd-7cd44944fa33 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:43.074052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:43.074733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.075009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.075288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.076017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:43.077612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.088107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1172/2321] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:01:43.092228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.102826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a350a1-a710-46e1-b7a1-c717e0007938 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:43.107683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:43.108559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.108871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.109723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] PATH_INFO: `/v3/projects/a80ae095a7b04074ae289e10604963a2/users/3ab1f1c59f2c4212b3a22d915938ebeb/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.124169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80ae095a7b04074ae289e10604963a2, user_id=3ab1f1c59f2c4212b3a22d915938ebeb, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:43.127496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.216946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1150/2322] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:01:43 2022] PUT /identity/v3/projects/a80ae095a7b04074ae289e10604963a2/users/3ab1f1c59f2c4212b3a22d915938ebeb/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:43.221357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.231729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6781a-6ac8-4c4f-a899-97b50797040f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:43.287356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469880cf-312f-4f68-8f4e-2754653531fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:43.288016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469880cf-312f-4f68-8f4e-2754653531fa admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.288356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469880cf-312f-4f68-8f4e-2754653531fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.288584 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469880cf-312f-4f68-8f4e-2754653531fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.289309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469880cf-312f-4f68-8f4e-2754653531fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:43.290955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469880cf-312f-4f68-8f4e-2754653531fa admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.295853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:43.301764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1173/2323] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:01:43.305582 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.316182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857de8-fa1e-4e96-bffe-e2319c9a871b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:43.320810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:43.321681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.321962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.322234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] PATH_INFO: `/v3/projects/a80ae095a7b04074ae289e10604963a2/users/3ab1f1c59f2c4212b3a22d915938ebeb/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.324249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80ae095a7b04074ae289e10604963a2, user_id=3ab1f1c59f2c4212b3a22d915938ebeb, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:43.329186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.337239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1151/2324] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:01:43 2022] PUT /identity/v3/projects/a80ae095a7b04074ae289e10604963a2/users/3ab1f1c59f2c4212b3a22d915938ebeb/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:43.349088 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a9bd-d65f-443a-8dc8-04563ad28004 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.349386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a9bd-d65f-443a-8dc8-04563ad28004 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.349670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a9bd-d65f-443a-8dc8-04563ad28004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.387125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b8f6a9bd-d65f-443a-8dc8-04563ad28004 None None] MFA Rules not processed for user `3ab1f1c59f2c4212b3a22d915938ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:43.388402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b8f6a9bd-d65f-443a-8dc8-04563ad28004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:43.467793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1174/2325] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:43.480043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.481712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:43.548568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13681a4-8e06-41bf-a986-fa8638d333af admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:43.553620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:43.554559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.555445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.555628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.567876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:43.569542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.579780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1152/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:43.694789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.697843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.697843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.718640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:43.719942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:43.775713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1175/2327] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jun 16 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:43.799993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.804081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:43.809345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2ee6-1046-4695-bfe0-19cd82e2181c service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:43.813573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:43.814314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:43.814611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:43.814903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:43.872029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:43.873447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:43.883332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1153/2328] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:43.939645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:43.940135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:44.008758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05840-cb7b-49db-b8d4-91d13ca7bc73 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:44.014185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:44.019943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:44.019943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:44.019943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:44.023610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:44.025192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:44.033706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1176/2329] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 12:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:01:49.011999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:49.013992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:49.096404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebca0f-3a16-4539-a578-19d274a10b52 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:49.105615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:49.105615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:49.106107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:49.106107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:49.107903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:49.120690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:49.122379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:49.133180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1154/2330] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:53.041871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:53.053428 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a215fd-a9fa-489f-acb6-d22031e690ed service swift] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:53.060749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:53.061384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:53.061675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:53.064973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:53.064973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:53.076194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:53.078349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:53.088531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1177/2331] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:53.219490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:53.221415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:53.304041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6e98d-cb23-4e67-8a03-a84cefbc0f14 service placement] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:53.309005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:53.310137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:53.310797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:53.311084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] PATH_INFO: `/v3/users/52c0db58ab734bfdb6b4fd46c6e04f13` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:53.312305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c0db58ab734bfdb6b4fd46c6e04f13)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:53.314233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:53.472578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:53.484514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c0db58ab734bfdb6b4fd46c6e04f13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:53.489120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c0db58ab734bfdb6b4fd46c6e04f13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:53.498396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c0db58ab734bfdb6b4fd46c6e04f13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:53.576337 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c0db58ab734bfdb6b4fd46c6e04f13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:53.589637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c0db58ab734bfdb6b4fd46c6e04f13'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:53.596763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1155/2332] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:01:53 2022] DELETE /identity/v3/users/52c0db58ab734bfdb6b4fd46c6e04f13 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:53.850202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:53.876855 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4add-481e-41e1-8363-f9d94b76f614 service placement] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:53.886510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:53.938940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:53.939795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:53.940077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:53.940349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] PATH_INFO: `/v3/projects/d0da495fb41a441ca5efeb5e8947710e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:53.941527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0da495fb41a441ca5efeb5e8947710e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:53.943462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:54.057342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0da495fb41a441ca5efeb5e8947710e', 'request_id': 'req-4eb647ab-4a8f-46c7-9de1-a3db40559d25'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.063425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0da495fb41a441ca5efeb5e8947710e', 'request_id': 'req-4eb647ab-4a8f-46c7-9de1-a3db40559d25'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.131153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0da495fb41a441ca5efeb5e8947710e', 'request_id': 'req-4eb647ab-4a8f-46c7-9de1-a3db40559d25'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.144677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] The token cache is being invalidate because project d0da495fb41a441ca5efeb5e8947710e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:01:54.144969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.145629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.148505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1178/2333] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:01:53 2022] DELETE /identity/v3/projects/d0da495fb41a441ca5efeb5e8947710e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:54.151204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:54.152622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:54.165841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415345db-68a2-4868-bd95-85d180ca3ad0 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:54.232010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:54.232932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:54.233218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:54.234476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] PATH_INFO: `/v3/users/8a7779993e0d4691a525b78d1d4ed68a` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:54.235740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7779993e0d4691a525b78d1d4ed68a)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:54.237669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:54.430079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7779993e0d4691a525b78d1d4ed68a'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.430827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7779993e0d4691a525b78d1d4ed68a'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.439922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7779993e0d4691a525b78d1d4ed68a'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.529099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7779993e0d4691a525b78d1d4ed68a'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.545853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-90f268e3-b716-4aa7-95fe-9982addb8cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7779993e0d4691a525b78d1d4ed68a'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:54.555288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1156/2334] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:01:54 2022] DELETE /identity/v3/users/8a7779993e0d4691a525b78d1d4ed68a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:54.851487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:54.852913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:54.866406 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb647ab-4a8f-46c7-9de1-a3db40559d25 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:54.931657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:54.932557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:54.934485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:54.934485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] PATH_INFO: `/v3/projects/b3a0c9f7fe0942a8acbe255c3f5f2244` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:54.934485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a0c9f7fe0942a8acbe255c3f5f2244)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:54.936340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.049730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:55.056713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a0c9f7fe0942a8acbe255c3f5f2244', 'request_id': 'req-f076ef31-22fb-43e5-bf2d-7b86c8edf870'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:55.062080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a0c9f7fe0942a8acbe255c3f5f2244', 'request_id': 'req-f076ef31-22fb-43e5-bf2d-7b86c8edf870'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:55.257272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a0c9f7fe0942a8acbe255c3f5f2244', 'request_id': 'req-f076ef31-22fb-43e5-bf2d-7b86c8edf870'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:55.269126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] The token cache is being invalidate because project b3a0c9f7fe0942a8acbe255c3f5f2244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:01:55.269432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:55.270101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f076ef31-22fb-43e5-bf2d-7b86c8edf870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:01:55.272675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1179/2335] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:01:54 2022] DELETE /identity/v3/projects/b3a0c9f7fe0942a8acbe255c3f5f2244 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:55.276804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.277303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.277401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.295295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:55.297045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:55.321339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:01:55.354994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1157/2336] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:55.363205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.364449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.364449 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.382468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:55.383804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:55.391977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1180/2337] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:01:55.396128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:55.406463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2deb24-7b8b-4936-8af0-18958d999170 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:55.411102 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:55.411791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.418631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.418631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.418631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:01:55.418631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:55.418631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.427391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1158/2338] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:01:55.431975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:55.441482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47770468-b047-4c70-8bfe-52a6bd976477 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:55.446993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:55.447648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.447931 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.448211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.448945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:55.450940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.546922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1181/2339] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:01:55 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:01:55.551026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:55.560770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b451e-931c-4620-a473-4329fbb3183f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:55.622074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:55.622799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.623727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.623969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.624701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:55.626620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.727859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1159/2340] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:01:55 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:01:55.741415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:55.753125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae215c4-fb63-4a65-abbf-2a70024d0be3 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:55.758391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:55.759140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.759427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.759707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.760549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:55.762195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.777186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1182/2341] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:01:55.779188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:55.793518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c8a49-cfb8-4bc7-a8f6-6f91da50fa6f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:55.798511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b901f0-4d95-4d77-bc15-87a8c931a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:55.799292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b901f0-4d95-4d77-bc15-87a8c931a679 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.799666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b901f0-4d95-4d77-bc15-87a8c931a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.800018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b901f0-4d95-4d77-bc15-87a8c931a679 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.800792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b901f0-4d95-4d77-bc15-87a8c931a679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:55.802473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b901f0-4d95-4d77-bc15-87a8c931a679 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.813495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1160/2342] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:01:55.817716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:55.829980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64266e-4e58-4faa-9af6-e2eeaa698033 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:55.834860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:55.835826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.836112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.836415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] PATH_INFO: `/v3/projects/ff126b753aee481bae3ecc8bb79cea34/users/c179da3d724749c9988092fde5195534/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.861330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff126b753aee481bae3ecc8bb79cea34, user_id=c179da3d724749c9988092fde5195534, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:55.864783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:55.964182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1183/2343] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:01:55 2022] PUT /identity/v3/projects/ff126b753aee481bae3ecc8bb79cea34/users/c179da3d724749c9988092fde5195534/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:01:55.966747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:55.967144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:55.967491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:55.988138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:01:55.990759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:56.059198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1161/2344] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:01:56.069290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:56.071373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:56.133061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ef7d-6235-494f-afb8-15e3706859ab admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:01:56.138100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5caad-d108-416a-8ffa-7c88f47b59cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:01:56.139370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5caad-d108-416a-8ffa-7c88f47b59cb service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:01:56.139846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5caad-d108-416a-8ffa-7c88f47b59cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:01:56.140849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5caad-d108-416a-8ffa-7c88f47b59cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:01:56.151671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5caad-d108-416a-8ffa-7c88f47b59cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:01:56.153150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5caad-d108-416a-8ffa-7c88f47b59cb service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:01:56.163155 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1184/2345] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:01:59.883808 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:01:59.885380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:01:59.944662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:00.017696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10d47-45fa-4e7d-918f-872a99c411cc None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:00.037793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:00.049372 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:00.049835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:00.050281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:00.054879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:00.079611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:00.081505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:00.105874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1162/2346] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:01:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:02.340552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8e033-95b7-404f-99c6-5d2c758f0af1 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:02.341439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8e033-95b7-404f-99c6-5d2c758f0af1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:02.342006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8e033-95b7-404f-99c6-5d2c758f0af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:02.387962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7ec8e033-95b7-404f-99c6-5d2c758f0af1 None None] MFA Rules not processed for user `c179da3d724749c9988092fde5195534`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:02.389660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7ec8e033-95b7-404f-99c6-5d2c758f0af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:02.458934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:02.467873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1185/2347] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:02.472836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:02.487556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58fc78-f618-414d-9e61-37510f27caed service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:02.503342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:02.504327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:02.504622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:02.505017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:02.505874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:02.507914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:02.531522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:02.531812 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:02.532081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:02.564688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:02.566062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:02.630528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1186/2348] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:02.646554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:02.648057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:02.679511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1163/2349] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:02 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:02.686307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:02.784411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b0fb-a4f1-4cd0-a132-0c9dc5d07c60 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:02.807459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ff25-c3a7-4e7a-b042-03e5c9a08b96 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:02.822967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:02.824641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:02.825889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:02.828182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:02.829601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:02.835340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:02.880401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:02.881070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:02.881355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:02.881634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:02.934191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1164/2350] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:02 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:02.942643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:02.963195 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e3e82-50bb-4965-a9e9-ab1e592a1008 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:02.963881 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:02.972658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:02.973347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:02.976223 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:02.976723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:02.977827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:02.987722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:02.987908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:02.989722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:03.000024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1165/2351] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:03.004600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1187/2352] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 12:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:02:03.013005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:03.025438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312b09f-3b06-4551-b69f-f7cee4902ef9 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:03.033500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:03.034681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:03.034804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:03.034976 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] PATH_INFO: `/v3/projects/3df460cfac4c4e148685a78ecd6572d9/users/0306a836dcda40be8b0ffef02ab14992/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:03.058805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df460cfac4c4e148685a78ecd6572d9, user_id=0306a836dcda40be8b0ffef02ab14992, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:03.062688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:03.192845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1166/2353] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:03 2022] PUT /identity/v3/projects/3df460cfac4c4e148685a78ecd6572d9/users/0306a836dcda40be8b0ffef02ab14992/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:03.196955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:03.221761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7700e-e236-4b34-9ca8-8824ab1380ae service swift] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:03.331327 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:03.332038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:03.335207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:03.335207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:03.335207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:03.338112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:03.365050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1188/2354] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:03.365880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:03.386342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eeb3e-c249-40c4-a297-8a70936e280f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:03.411188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c582dc-2143-4666-b45c-f80e39030393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:03.418183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c582dc-2143-4666-b45c-f80e39030393 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:03.420457 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c582dc-2143-4666-b45c-f80e39030393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:03.430141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c582dc-2143-4666-b45c-f80e39030393 admin admin] PATH_INFO: `/v3/projects/3df460cfac4c4e148685a78ecd6572d9/users/0306a836dcda40be8b0ffef02ab14992/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:03.433106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c582dc-2143-4666-b45c-f80e39030393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df460cfac4c4e148685a78ecd6572d9, user_id=0306a836dcda40be8b0ffef02ab14992, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:03.436191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c582dc-2143-4666-b45c-f80e39030393 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:03.449523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1167/2355] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:03 2022] PUT /identity/v3/projects/3df460cfac4c4e148685a78ecd6572d9/users/0306a836dcda40be8b0ffef02ab14992/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:03.909139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:03.918890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:03.939570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ead6-5fe6-485c-84af-f01ed07dc7fd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:04.009048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:04.010002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:04.010474 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:04.010788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] PATH_INFO: `/v3/users/8cde124903bc4b6aa5bb1f089d7b9da1` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:04.012040 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cde124903bc4b6aa5bb1f089d7b9da1)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:04.013997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:04.281532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cde124903bc4b6aa5bb1f089d7b9da1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:04.283125 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cde124903bc4b6aa5bb1f089d7b9da1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:04.389386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cde124903bc4b6aa5bb1f089d7b9da1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:04.398617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cde124903bc4b6aa5bb1f089d7b9da1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:04.422636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cde124903bc4b6aa5bb1f089d7b9da1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:04.439409 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:04.441447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1189/2356] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:03 2022] DELETE /identity/v3/users/8cde124903bc4b6aa5bb1f089d7b9da1 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:04.442994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:04.443497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:04.443604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:04.492362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:04.499866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:04.599580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:04.642203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1168/2357] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:04.657227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:04.658807 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:04.741833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766399a8-2a92-4d88-9e12-3b371cbbe6fa admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:04.746454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:04.747669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:04.748221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:04.748679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:04.765743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:04.768663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:04.778000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1190/2358] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:05.499256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:05.500724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:05.532861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94cc50-fa51-4475-9c6f-9d7b7873ebf3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:05.538957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:05.539864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:05.540451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:05.540614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] PATH_INFO: `/v3/projects/caa7c5dd28ab43db99246107e2b5142d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:05.542629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa7c5dd28ab43db99246107e2b5142d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:05.556493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:05.745207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa7c5dd28ab43db99246107e2b5142d', 'request_id': 'req-af815206-00b0-4476-9049-5f1fe904a36f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:05.763245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa7c5dd28ab43db99246107e2b5142d', 'request_id': 'req-af815206-00b0-4476-9049-5f1fe904a36f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:05.850272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa7c5dd28ab43db99246107e2b5142d', 'request_id': 'req-af815206-00b0-4476-9049-5f1fe904a36f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:05.878334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] The token cache is being invalidate because project caa7c5dd28ab43db99246107e2b5142d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:05.878680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:05.891170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:05.893865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1169/2359] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:05 2022] DELETE /identity/v3/projects/caa7c5dd28ab43db99246107e2b5142d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:05.897074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:05.908943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14cab4-83a7-481a-afdc-1731c86a0c70 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:05.981330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:05.982654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:05.983128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:05.983846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] PATH_INFO: `/v3/users/3ab1f1c59f2c4212b3a22d915938ebeb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:05.985886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab1f1c59f2c4212b3a22d915938ebeb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:05.989370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:06.230947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab1f1c59f2c4212b3a22d915938ebeb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:06.231923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab1f1c59f2c4212b3a22d915938ebeb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:06.319635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab1f1c59f2c4212b3a22d915938ebeb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:06.341633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab1f1c59f2c4212b3a22d915938ebeb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:06.390643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab1f1c59f2c4212b3a22d915938ebeb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:06.418964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1191/2360] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:05 2022] DELETE /identity/v3/users/3ab1f1c59f2c4212b3a22d915938ebeb => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:06.845762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:06.847889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:07.051495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af815206-00b0-4476-9049-5f1fe904a36f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:07.217426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:07.246147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:07.246966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:07.247255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:07.247538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:07.263038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:07.524327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:07.526420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:07.542611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1170/2361] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:07.814162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:07.816000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:07.853705 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:07.991388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291e2c-a067-48c4-91d7-7ae87b7958d2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:07.993165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:07.993602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:08.019655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:08.020611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:08.020903 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:08.021247 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] PATH_INFO: `/v3/projects/a80ae095a7b04074ae289e10604963a2` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:08.022714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80ae095a7b04074ae289e10604963a2)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:08.025467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:08.119595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bbe0-1c97-43cd-9cb5-21df8f8cd113 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:08.129678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:08.130551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:08.131039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:08.132042 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:08.138040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:08.178128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:08.180300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8ba61-24aa-4876-b4f8-848079da6358 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:08.200200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1171/2362] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:08.204405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80ae095a7b04074ae289e10604963a2', 'request_id': 'req-e1533bd7-050f-4b04-ba89-a27a4f088e2b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:08.217738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80ae095a7b04074ae289e10604963a2', 'request_id': 'req-e1533bd7-050f-4b04-ba89-a27a4f088e2b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:08.318110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80ae095a7b04074ae289e10604963a2', 'request_id': 'req-e1533bd7-050f-4b04-ba89-a27a4f088e2b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:08.335653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] The token cache is being invalidate because project a80ae095a7b04074ae289e10604963a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:08.336055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:08.337021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1533bd7-050f-4b04-ba89-a27a4f088e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:08.342190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1192/2363] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:07 2022] DELETE /identity/v3/projects/a80ae095a7b04074ae289e10604963a2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:08.344259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101269-47ae-4318-82b9-979ac5379216 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:08.344861 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101269-47ae-4318-82b9-979ac5379216 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:08.345443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101269-47ae-4318-82b9-979ac5379216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:08.387485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-27101269-47ae-4318-82b9-979ac5379216 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:08.389188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-27101269-47ae-4318-82b9-979ac5379216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:08.550407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:08.550938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1172/2364] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:08.552585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:08.553113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:08.590694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:08.592134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:08.617216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1193/2365] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:08.622625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27101269-47ae-4318-82b9-979ac5379216 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:08.635692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27101269-47ae-4318-82b9-979ac5379216 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:08.649897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:08.652425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:08.652425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:08.652425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:08.652425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:08.652425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:08.654450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:08.712316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1173/2366] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:08.713136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:08.727617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222faabd-5a81-4df9-b14a-8eb12ef020b0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:08.739711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:08.740405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:08.740689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:08.741175 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:08.741872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:08.743922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:08.854490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1194/2367] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:08 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:08.859645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:08.874002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5d47-138b-4f70-b88d-ddc9fe5441a1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:08.939986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:09.019928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:09.021583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:09.022099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:09.022770 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:09.026978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:09.030056 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:09.175246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1174/2368] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:08 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:09.179489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:09.207562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91840-cd12-4ece-94eb-675c891fdbfc admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:09.242620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:09.246362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:09.246525 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:09.246704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:09.247473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:09.249170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:09.294902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1195/2369] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:09.298558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:09.319012 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a409-326a-49fd-b5cb-6508185f0738 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:09.347283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852301-d293-4038-8ef5-bba3d339e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:09.348349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852301-d293-4038-8ef5-bba3d339e631 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:09.350393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852301-d293-4038-8ef5-bba3d339e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:09.351077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852301-d293-4038-8ef5-bba3d339e631 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:09.357466 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852301-d293-4038-8ef5-bba3d339e631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:09.384591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852301-d293-4038-8ef5-bba3d339e631 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:09.423715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:09.436198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1175/2370] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:09.440385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d294203-d9db-4b89-84f2-3eea5c5a6cc7 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:09.450075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:09.451415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:09.454657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:09.457479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] PATH_INFO: `/v3/projects/67f2f4ac2a7e40dcbc95c2c4a44ed34e/users/ecca71d90e46440dbae915bd604ca58f/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:09.517660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f2f4ac2a7e40dcbc95c2c4a44ed34e, user_id=ecca71d90e46440dbae915bd604ca58f, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:09.537763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:09.634792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1196/2371] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:09 2022] PUT /identity/v3/projects/67f2f4ac2a7e40dcbc95c2c4a44ed34e/users/ecca71d90e46440dbae915bd604ca58f/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:09.654621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:09.654621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:09.654621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:09.738659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] MFA Rules not processed for user `ecca71d90e46440dbae915bd604ca58f`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:09.743601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:09.844182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1176/2372] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:09.848670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:09.957497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:09.973739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78c6c9-0034-48e4-ad01-9b3c4e81072b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:09.979462 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:09.982062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:09.982562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:09.983096 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:09.984064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:09.986395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:10.090700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1197/2373] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:09 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:10.095539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:10.120173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64bf83-5482-4219-bf15-80f585305c34 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:10.287268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:10.287964 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:10.288250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:10.288773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:10.289561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:10.291651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:10.405510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1177/2374] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:10 2022] POST /identity/v3/users => generated 299 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:10.409663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:10.427395 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e508f-abe8-42bb-8546-7bfe4133c553 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:10.435543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:10.437080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:10.437490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:10.438013 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:10.439259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:10.442443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:10.465974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1198/2375] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:10.470394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:10.485306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d18aa-5c5e-4c1a-bc7f-5d0d69ad3ca1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:10.495858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:10.499614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:10.500074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:10.500186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] PATH_INFO: `/v3/projects/7f4d6c287b984ea8b54d93ad8c8e0563/users/3cbc4b9da6fe48128d159d099101e011/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:10.535386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d6c287b984ea8b54d93ad8c8e0563, user_id=3cbc4b9da6fe48128d159d099101e011, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:10.540108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:10.663656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1178/2376] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:10 2022] PUT /identity/v3/projects/7f4d6c287b984ea8b54d93ad8c8e0563/users/3cbc4b9da6fe48128d159d099101e011/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:10.667136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:10.682969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dc978-2e72-48f7-bcd1-0213083a6d32 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:10.852461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a9099-2228-4461-a573-6645bb3905fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:10.853912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9099-2228-4461-a573-6645bb3905fc admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:10.854405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9099-2228-4461-a573-6645bb3905fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:10.854958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9099-2228-4461-a573-6645bb3905fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:10.856544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a9099-2228-4461-a573-6645bb3905fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:10.862002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a9099-2228-4461-a573-6645bb3905fc admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:10.878945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1199/2377] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:10.883000 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:10.888979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:10.901509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0888-443c-4845-9207-cf125143b703 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:10.921631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:10.921752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:10.922001 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:10.922263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] PATH_INFO: `/v3/projects/7f4d6c287b984ea8b54d93ad8c8e0563/users/3cbc4b9da6fe48128d159d099101e011/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:10.925477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d6c287b984ea8b54d93ad8c8e0563, user_id=3cbc4b9da6fe48128d159d099101e011, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:10.929852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:10.943753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1179/2378] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:10 2022] PUT /identity/v3/projects/7f4d6c287b984ea8b54d93ad8c8e0563/users/3cbc4b9da6fe48128d159d099101e011/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:10.956467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:10.956829 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:10.957217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:11.026492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] MFA Rules not processed for user `3cbc4b9da6fe48128d159d099101e011`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:11.029129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:11.228888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1200/2379] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:11.241420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:11.243496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:11.417953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb7a7e-f41e-4d15-8b8d-3b7dfb9eb14a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:11.423858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f619f-9ee7-4e78-8f6c-2fb126760318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:11.424775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f619f-9ee7-4e78-8f6c-2fb126760318 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:11.425912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f619f-9ee7-4e78-8f6c-2fb126760318 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:11.425912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f619f-9ee7-4e78-8f6c-2fb126760318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:11.441323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f619f-9ee7-4e78-8f6c-2fb126760318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:11.445284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f619f-9ee7-4e78-8f6c-2fb126760318 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:11.458484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1180/2380] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:11.523440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:11.662337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:11.708329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b90a9-cd46-4d7e-8128-cb84a0ce643a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:11.719354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:11.721663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:11.721976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:11.722262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] PATH_INFO: `/v3/users/ecca71d90e46440dbae915bd604ca58f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:11.725682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecca71d90e46440dbae915bd604ca58f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:11.729752 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:12.024444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecca71d90e46440dbae915bd604ca58f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:12.025656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecca71d90e46440dbae915bd604ca58f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:12.116981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecca71d90e46440dbae915bd604ca58f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:12.131199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecca71d90e46440dbae915bd604ca58f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:12.157887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecca71d90e46440dbae915bd604ca58f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:12.174531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1201/2381] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:11 2022] DELETE /identity/v3/users/ecca71d90e46440dbae915bd604ca58f => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:12.178865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:12.179352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:12.179710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:12.217936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:12.219322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:12.375628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1181/2382] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:12.392487 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:12.393099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:12.571763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a88dd-af73-4b0a-b85a-7d4a0ce797e8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:12.588506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:12.593993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:12.595872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:12.596419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:12.617693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:12.619971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:12.638706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1202/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:13.683553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:13.685021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:13.712789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99232085-b88e-41f5-a029-4c8ebc507c87 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:13.729672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:13.732783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:13.733913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:13.734397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] PATH_INFO: `/v3/projects/67f2f4ac2a7e40dcbc95c2c4a44ed34e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:13.736633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f2f4ac2a7e40dcbc95c2c4a44ed34e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:13.739050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:13.932048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f2f4ac2a7e40dcbc95c2c4a44ed34e', 'request_id': 'req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:13.949762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f2f4ac2a7e40dcbc95c2c4a44ed34e', 'request_id': 'req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.053567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f2f4ac2a7e40dcbc95c2c4a44ed34e', 'request_id': 'req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.080255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] The token cache is being invalidate because project 67f2f4ac2a7e40dcbc95c2c4a44ed34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:14.080791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.082735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d9c2a928-ef44-4d9f-b876-e3fb873a7db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.094105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1182/2384] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:13 2022] DELETE /identity/v3/projects/67f2f4ac2a7e40dcbc95c2c4a44ed34e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:14.095692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:14.109046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d2c9f-6895-4cca-be3c-f5952837aaed service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:14.342127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:14.343151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:14.343977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:14.344274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] PATH_INFO: `/v3/users/3cbc4b9da6fe48128d159d099101e011` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:14.347833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbc4b9da6fe48128d159d099101e011)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:14.352288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:14.369867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:14.449527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:14.449816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:14.450098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:14.496188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] MFA Rules not processed for user `0306a836dcda40be8b0ffef02ab14992`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:14.497350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:14.502436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:14.605688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1183/2385] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:14.624117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:14.627526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:14.690401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbc4b9da6fe48128d159d099101e011'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.690401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbc4b9da6fe48128d159d099101e011'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.739160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c57b59-e726-4f58-b781-89ee4293b853 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:14.745605 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:14.753400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:14.753400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:14.753400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:14.753400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:14.765622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbc4b9da6fe48128d159d099101e011'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.776996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbc4b9da6fe48128d159d099101e011'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.806712 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbc4b9da6fe48128d159d099101e011'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:14.816898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1203/2386] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:14 2022] DELETE /identity/v3/users/3cbc4b9da6fe48128d159d099101e011 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:14.865415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:14.867470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f43b7-e4f2-4467-aca7-0f109ddd62fa service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:14.895303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1184/2387] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:15.711095 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:15.714183 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:15.833382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f30658-0526-48a3-81bc-03777103b157 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:15.935014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:15.935014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:15.935014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:15.935014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] PATH_INFO: `/v3/projects/7f4d6c287b984ea8b54d93ad8c8e0563` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:15.936625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4d6c287b984ea8b54d93ad8c8e0563)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:15.936625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:16.081774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4d6c287b984ea8b54d93ad8c8e0563', 'request_id': 'req-504b535a-d620-4f0c-8c61-5c3749ef997c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:16.095727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4d6c287b984ea8b54d93ad8c8e0563', 'request_id': 'req-504b535a-d620-4f0c-8c61-5c3749ef997c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:16.199342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4d6c287b984ea8b54d93ad8c8e0563', 'request_id': 'req-504b535a-d620-4f0c-8c61-5c3749ef997c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:16.212626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] The token cache is being invalidate because project 7f4d6c287b984ea8b54d93ad8c8e0563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:16.213123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:16.214736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-504b535a-d620-4f0c-8c61-5c3749ef997c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:16.221112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1204/2388] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:15 2022] DELETE /identity/v3/projects/7f4d6c287b984ea8b54d93ad8c8e0563 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:16.222602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:16.223081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:16.223164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:16.255947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:16.262674 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:16.338387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:16.397280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1185/2389] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:16.404865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:16.408786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:16.408786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:16.446815 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:16.449107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:16.474136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1205/2390] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:16.477803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:16.494780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80cc8-0ec8-4245-8578-012304501fc7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:16.505153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:16.506026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:16.506462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:16.506909 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:16.507796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:16.508258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:16.510281 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:16.544491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1186/2391] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:16.549251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:16.567027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c89512-57ed-48dc-a89e-05ce61abfa1f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:16.590899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:16.593204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:16.593699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:16.595033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:16.597711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:16.601436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:16.629647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:16.704533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:16.706673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:16.735170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86fc6-efca-4276-8a1a-e0750fc7a9dd admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:16.750283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:16.751654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:16.751900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:16.752218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] PATH_INFO: `/v3/users/d3b2fff3179d40c58d41c1bb422454f6` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:16.760314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b2fff3179d40c58d41c1bb422454f6)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:16.763771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:16.770820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1206/2392] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:16 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:16.772582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:16.961535 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79621-3601-48b7-91b9-438fae1bc15b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:16.968182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:16.969720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:16.970285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:16.971008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:16.973411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:16.983045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:17.127352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1207/2393] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:16 2022] POST /identity/v3/users => generated 294 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:17.127352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:17.129536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:17.156917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b2fff3179d40c58d41c1bb422454f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:17.162544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b2fff3179d40c58d41c1bb422454f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:17.182280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b2fff3179d40c58d41c1bb422454f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:17.250825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b2fff3179d40c58d41c1bb422454f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:17.270546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b2fff3179d40c58d41c1bb422454f6'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:17.271997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3bbdf-2910-4095-bc91-143d3c7fcb10 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:17.283182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1187/2394] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:16 2022] DELETE /identity/v3/users/d3b2fff3179d40c58d41c1bb422454f6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:17.284706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:17.299001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:17.299677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:17.299981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:17.300235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:17.304749 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:17.314042 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:17.344954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:17.346390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:17.374156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1208/2395] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:17.487550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d71faf-5f9a-42af-a256-f51ba7f9cf54 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:17.498968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:17.500005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:17.500442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:17.500871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:17.501754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:17.503573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:17.526048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:17.526567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1188/2396] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:17.539235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb0914-dc01-49e5-a4c7-a8e195fc0693 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:17.544964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16154d-2a92-4db1-a768-d702e6b6e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:17.545667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16154d-2a92-4db1-a768-d702e6b6e9dd admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:17.545979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16154d-2a92-4db1-a768-d702e6b6e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:17.546254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16154d-2a92-4db1-a768-d702e6b6e9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:17.547071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16154d-2a92-4db1-a768-d702e6b6e9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:17.549069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16154d-2a92-4db1-a768-d702e6b6e9dd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:17.570002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1209/2397] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:17.574037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:17.591231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e701-34c7-4139-8944-68b82890400f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:17.607485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:17.608498 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:17.608791 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:17.609095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] PATH_INFO: `/v3/projects/5f33ec2475b44090a907168c583d4c54/users/53681b0643194672bfafe215a30ae8ab/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:17.641677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f33ec2475b44090a907168c583d4c54, user_id=53681b0643194672bfafe215a30ae8ab, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:17.647353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:17.735667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1189/2398] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:17 2022] PUT /identity/v3/projects/5f33ec2475b44090a907168c583d4c54/users/53681b0643194672bfafe215a30ae8ab/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:17.748118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:17.748654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:17.749912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:17.805112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] MFA Rules not processed for user `53681b0643194672bfafe215a30ae8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:17.806549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:17.902063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:17.904071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:17.918368 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:17.929093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:17.939334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1210/2399] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:17.941066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.046171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1eaf8-9a4d-4bb3-82bb-f5f345531e75 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.058895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.060121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.060568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.061223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.063597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.066753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67d528-4f6a-4774-a140-07509e36e1f1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.075052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.075716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.076006 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.076280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] PATH_INFO: `/v3/projects/9605590a14fd4c889535b000aa064a09` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.077108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.077565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9605590a14fd4c889535b000aa064a09)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.079536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.195954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1211/2400] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:17 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:18.197199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.269860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9605590a14fd4c889535b000aa064a09', 'request_id': 'req-0fee0129-e2f8-4502-900b-470cf1276df4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:18.282100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9605590a14fd4c889535b000aa064a09', 'request_id': 'req-0fee0129-e2f8-4502-900b-470cf1276df4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:18.367536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9605590a14fd4c889535b000aa064a09', 'request_id': 'req-0fee0129-e2f8-4502-900b-470cf1276df4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:18.389119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c93fc-8dcd-4478-96fa-0a40d4e96c84 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.392353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] The token cache is being invalidate because project 9605590a14fd4c889535b000aa064a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:18.392953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:18.393874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0fee0129-e2f8-4502-900b-470cf1276df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:18.403890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1190/2401] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:17 2022] DELETE /identity/v3/projects/9605590a14fd4c889535b000aa064a09 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:18.408820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb594f7-d9eb-4d35-a625-3ad7ff312556 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.411894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb594f7-d9eb-4d35-a625-3ad7ff312556 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.412447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb594f7-d9eb-4d35-a625-3ad7ff312556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.466299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3cb594f7-d9eb-4d35-a625-3ad7ff312556 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:18.468505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3cb594f7-d9eb-4d35-a625-3ad7ff312556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:18.485532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.488831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.488831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.488831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.488831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.490991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.575310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1191/2402] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:18.583087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.583375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.584188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.606859 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1212/2403] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:18 2022] POST /identity/v3/users => generated 300 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:18.612371 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.614465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:18.628604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:18.632232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:18.641323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be6c9-2637-466e-9b49-8d0a16151a52 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.654395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1192/2404] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:18.659127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.666612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.667792 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.672385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.672745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.672745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.672745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.694369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a455d5-61ca-4323-b1b9-b42f1007408c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.705390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1213/2405] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:18.705623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.705623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.705623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.705623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.706174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:18.706174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.707252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.708180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.723867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1193/2406] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:18.727014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3831e7f-0d8d-4842-a44f-79e30cf72546 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.728994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.737341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.740273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.740647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.744250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] PATH_INFO: `/v3/projects/9bb76b5907594fac820c99cbadd6f635/users/b46d9955a907429ab1eb3dfad8afda87/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.745406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674da3-0778-4d14-b14c-db704992f04c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:18.749194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:18.749870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:18.750158 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:18.750819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:18.751912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:18.753611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.755904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.772733 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb76b5907594fac820c99cbadd6f635, user_id=b46d9955a907429ab1eb3dfad8afda87, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:18.775693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:18.871762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:18.895108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1194/2407] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:18 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:18.896194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:18.945693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1214/2408] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:18 2022] PUT /identity/v3/projects/9bb76b5907594fac820c99cbadd6f635/users/b46d9955a907429ab1eb3dfad8afda87/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:18.949964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.071727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c2c7-51d3-46ad-9df3-e494b407eea7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.117837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49724b5-ffd0-4cdf-b3a6-476d636fdb5e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.153858 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.154821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.156732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.157178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.158099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.163496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.189673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1215/2409] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:19.190922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.220658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769ff75-7275-4734-a553-23a08a5bebf5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.230029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.230763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.231054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.231334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.232153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.234187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.235714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd54ca-5601-43b4-9c97-333e43724101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.236892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd54ca-5601-43b4-9c97-333e43724101 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.237390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd54ca-5601-43b4-9c97-333e43724101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.238051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd54ca-5601-43b4-9c97-333e43724101 admin admin] PATH_INFO: `/v3/projects/9bb76b5907594fac820c99cbadd6f635/users/b46d9955a907429ab1eb3dfad8afda87/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.248093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd54ca-5601-43b4-9c97-333e43724101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb76b5907594fac820c99cbadd6f635, user_id=b46d9955a907429ab1eb3dfad8afda87, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.253530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd54ca-5601-43b4-9c97-333e43724101 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.283662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1216/2410] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:19 2022] PUT /identity/v3/projects/9bb76b5907594fac820c99cbadd6f635/users/b46d9955a907429ab1eb3dfad8afda87/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:19.285270 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.285568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.285851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.332261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] MFA Rules not processed for user `b46d9955a907429ab1eb3dfad8afda87`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:19.333932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:19.341732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1195/2411] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:18 2022] POST /identity/v3/users => generated 290 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:19.345984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.366137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da515d1-2dcf-48b9-babe-e9018b9f876b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.487085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1217/2412] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:19.488870 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.489253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.489634 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.489925 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.490838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.493159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.497826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.500197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:19.518988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1196/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:19.523165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.542199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eadebf-3520-4dbb-afba-0c2fa3ea6584 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.553578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.558782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.558782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.558782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.558782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.558782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.583254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1197/2414] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:19.586874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.603138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fca334-a8be-4dee-b191-2e5f0819ff94 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.611648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.613211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.613767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.614499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] PATH_INFO: `/v3/projects/0e66f4f7eec64abb828b50a9f702b611/users/eb23dca9e4ac43b29987b39acd7b75ef/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.646144 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e66f4f7eec64abb828b50a9f702b611, user_id=eb23dca9e4ac43b29987b39acd7b75ef, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.646357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199dc43-5b3e-4732-ba52-9f337f4dab3f None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:19.649604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.653262 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71689-54fc-477b-abab-0427353cda2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:19.654825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71689-54fc-477b-abab-0427353cda2e service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.655757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71689-54fc-477b-abab-0427353cda2e service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.656047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71689-54fc-477b-abab-0427353cda2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.657317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:19.667291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:19.677407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d71689-54fc-477b-abab-0427353cda2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:19.680061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d71689-54fc-477b-abab-0427353cda2e service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:19.698276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1218/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:19.749718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1198/2416] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:19 2022] PUT /identity/v3/projects/0e66f4f7eec64abb828b50a9f702b611/users/eb23dca9e4ac43b29987b39acd7b75ef/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:19.759692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89a00e-e59a-4593-8253-8e30c0a98540 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.759986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89a00e-e59a-4593-8253-8e30c0a98540 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.760271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89a00e-e59a-4593-8253-8e30c0a98540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:19.800626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8c89a00e-e59a-4593-8253-8e30c0a98540 None None] MFA Rules not processed for user `eb23dca9e4ac43b29987b39acd7b75ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:19.801862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8c89a00e-e59a-4593-8253-8e30c0a98540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:19.922658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1219/2417] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:19.924157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:19.995808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:19.996790 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:19.997507 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:20.025399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] MFA Rules not processed for user `c179da3d724749c9988092fde5195534`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:20.028075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:20.135780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae48a8-47f7-4d80-a6bc-5d3b02bcc1d4 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:20.149101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:20.149805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:20.150092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:20.150377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:20.151113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:20.154112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:20.166254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1220/2418] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:20.269987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1199/2419] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:19 2022] POST /identity/v3/projects => generated 381 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:20.274108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:20.293640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ab5e8-6888-4e28-a7f0-fcd47cafaa09 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:20.504425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:20.505114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:20.505394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:20.505718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:20.506722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:20.509038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:20.662839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1221/2420] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:20 2022] POST /identity/v3/users => generated 297 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:20.663612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:20.676708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb9eb-be21-452a-a429-35a1548dc24e admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:20.691266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:20.692330 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:20.693950 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:20.694423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:20.695955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:20.699606 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:20.712839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1200/2421] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:20.717150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:20.728995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c2f3-7c4b-4d10-bdf1-7e7947c32334 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:20.735135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:20.736082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:20.736368 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:20.736698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] PATH_INFO: `/v3/projects/e963ac83c26b4d9396b05d2eceb79169/users/ebf94acbb7654511a3b970edb640f991/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:20.760489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e963ac83c26b4d9396b05d2eceb79169, user_id=ebf94acbb7654511a3b970edb640f991, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:20.763332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:20.767698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:20.839345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1222/2422] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:20 2022] PUT /identity/v3/projects/e963ac83c26b4d9396b05d2eceb79169/users/ebf94acbb7654511a3b970edb640f991/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:20.841772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:20.877237 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec202-5fe9-4fbb-8929-d07192b7b95b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:21.089292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b38a95-55be-4ada-8990-e9b7899ab1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:21.096480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b38a95-55be-4ada-8990-e9b7899ab1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:21.097325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b38a95-55be-4ada-8990-e9b7899ab1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:21.097815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b38a95-55be-4ada-8990-e9b7899ab1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:21.098803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b38a95-55be-4ada-8990-e9b7899ab1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:21.100618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b38a95-55be-4ada-8990-e9b7899ab1b3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:21.137949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1201/2423] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:21.143144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:21.161364 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1e38b-7dcc-4609-a21f-faa49935eba0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:21.181774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:21.185441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:21.185736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:21.186024 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] PATH_INFO: `/v3/projects/e963ac83c26b4d9396b05d2eceb79169/users/ebf94acbb7654511a3b970edb640f991/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:21.196686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e963ac83c26b4d9396b05d2eceb79169, user_id=ebf94acbb7654511a3b970edb640f991, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:21.204756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:21.248755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:21.249216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:21.249736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:21.252468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1223/2424] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:21 2022] PUT /identity/v3/projects/e963ac83c26b4d9396b05d2eceb79169/users/ebf94acbb7654511a3b970edb640f991/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:21.297700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] MFA Rules not processed for user `ebf94acbb7654511a3b970edb640f991`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:21.299448 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:21.478721 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:21.540305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1202/2425] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:21.571511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:21.573890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:21.711700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449c103-2dd8-4ea1-9755-273d2d38cdcd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:21.732611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:21.735370 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:21.735770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:21.741340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:21.757811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:21.759285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:21.782471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1224/2426] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:21.876240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:22.011661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1dab4-9c14-42ab-8599-299965188210 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:22.017364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:22.018282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:22.018563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:22.018863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] PATH_INFO: `/v3/users/53681b0643194672bfafe215a30ae8ab` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:22.020075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53681b0643194672bfafe215a30ae8ab)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:22.033505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:22.116268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:22.127520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8489c5-dbcc-4476-865d-0f849eefd682 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:22.138734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49393-c921-4a06-9d52-a50ac77f8262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:22.138734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49393-c921-4a06-9d52-a50ac77f8262 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:22.138734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49393-c921-4a06-9d52-a50ac77f8262 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:22.138734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49393-c921-4a06-9d52-a50ac77f8262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:22.246628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49393-c921-4a06-9d52-a50ac77f8262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:22.246628 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49393-c921-4a06-9d52-a50ac77f8262 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:22.255026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1225/2427] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:22.622041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53681b0643194672bfafe215a30ae8ab'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:22.622828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53681b0643194672bfafe215a30ae8ab'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:22.633146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53681b0643194672bfafe215a30ae8ab'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:22.785497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53681b0643194672bfafe215a30ae8ab'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:22.821149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53681b0643194672bfafe215a30ae8ab'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:22.850551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1203/2428] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:21 2022] DELETE /identity/v3/users/53681b0643194672bfafe215a30ae8ab => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:22.864523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:22.865107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:22.865572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:22.899943 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:22.902231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:23.021315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1226/2429] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:23.033560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:23.042693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:23.149978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ccd8-1d76-47e1-a1ce-55328083da80 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:23.156984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:23.158412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:23.158875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:23.159774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:23.174434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:23.176722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:23.193556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1204/2430] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:23.758877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:23.761139 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:23.776064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1153302-0640-40ed-a7f3-bd7a97082fa6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:23.781424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:23.782290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:23.782572 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:23.783363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] PATH_INFO: `/v3/projects/5f33ec2475b44090a907168c583d4c54` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:23.786620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f33ec2475b44090a907168c583d4c54)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:23.786620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:23.824402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:23.958477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f33ec2475b44090a907168c583d4c54', 'request_id': 'req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:23.964527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f33ec2475b44090a907168c583d4c54', 'request_id': 'req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.067302 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f33ec2475b44090a907168c583d4c54', 'request_id': 'req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.080422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] The token cache is being invalidate because project 5f33ec2475b44090a907168c583d4c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:24.080716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.081379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.082993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1227/2431] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:23 2022] DELETE /identity/v3/projects/5f33ec2475b44090a907168c583d4c54 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:24.087078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:24.097693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdda9b3-88be-4ed6-a2fa-5b8749a4019a service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:24.107665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:24.156220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:24.157059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:24.157344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:24.157650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] PATH_INFO: `/v3/users/b46d9955a907429ab1eb3dfad8afda87` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:24.158882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46d9955a907429ab1eb3dfad8afda87)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:24.161047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:24.353783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46d9955a907429ab1eb3dfad8afda87'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.354910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46d9955a907429ab1eb3dfad8afda87'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.382686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46d9955a907429ab1eb3dfad8afda87'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.441878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46d9955a907429ab1eb3dfad8afda87'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.455789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-83ebb0f8-ab16-45f5-9346-3f3d8b7551aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46d9955a907429ab1eb3dfad8afda87'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:24.461893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1205/2432] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:24 2022] DELETE /identity/v3/users/b46d9955a907429ab1eb3dfad8afda87 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:24.908181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:24.910962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:24.932532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0dec5-51ef-4a28-8515-a80d6f4b6e6d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.003119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.004050 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.004373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.004677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] PATH_INFO: `/v3/projects/9bb76b5907594fac820c99cbadd6f635` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.005954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb76b5907594fac820c99cbadd6f635)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.008382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.146489 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb76b5907594fac820c99cbadd6f635', 'request_id': 'req-7355e246-050a-47f7-8c55-0bec04384645'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:25.153684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb76b5907594fac820c99cbadd6f635', 'request_id': 'req-7355e246-050a-47f7-8c55-0bec04384645'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:25.248131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb76b5907594fac820c99cbadd6f635', 'request_id': 'req-7355e246-050a-47f7-8c55-0bec04384645'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:25.260767 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] The token cache is being invalidate because project 9bb76b5907594fac820c99cbadd6f635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:25.261161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:25.261875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-7355e246-050a-47f7-8c55-0bec04384645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:25.263552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1228/2433] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:24 2022] DELETE /identity/v3/projects/9bb76b5907594fac820c99cbadd6f635 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:25.274318 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.275055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.275423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.306109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:25.307701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:25.397507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1206/2434] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:25.405715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.406074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.406601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.433355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:25.434922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:25.445683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1229/2435] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:25.450670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:25.463877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c2692-4145-493d-9aa3-6964c73af5f0 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.469093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.470025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.470414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.470811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.472327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:25.472653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.474357 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.487692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1207/2436] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:25.492099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:25.507322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78751f2-1566-4eb4-9cb6-e4841da4b3b9 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.515719 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.516420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.516709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.516987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.517919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.519873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.612369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:25.629437 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1230/2437] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:25 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:25.633287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:25.644949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a429da-d41c-421b-9bfd-643a19503790 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.667760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:25.709154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.709827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.710113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.710390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.711107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.713027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.807967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1208/2438] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:25 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:25.809204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:25.819573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6e97-9ad5-416e-bb8a-aacbc7c5a429 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.824410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.825069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.825349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.825624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.826381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.828529 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.840555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1231/2439] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:25.845213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:25.855853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fae4c-9987-449e-af84-96798229c954 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.861571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84b34a-84e2-4d6c-9753-1349ac606a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.862229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b34a-84e2-4d6c-9753-1349ac606a52 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.867016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b34a-84e2-4d6c-9753-1349ac606a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.867016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b34a-84e2-4d6c-9753-1349ac606a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.867016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84b34a-84e2-4d6c-9753-1349ac606a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.867016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84b34a-84e2-4d6c-9753-1349ac606a52 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.875985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1209/2440] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:25.880518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:25.890914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807dec-8d16-4fd7-92ea-c15dc74fb69d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:25.895923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:25.896671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:25.896950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:25.897224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] PATH_INFO: `/v3/projects/229a3754823644dfac3348c5da219074/users/ca75c14f140343f9b56e685ea4e14c1a/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:25.913731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229a3754823644dfac3348c5da219074, user_id=ca75c14f140343f9b56e685ea4e14c1a, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:25.916454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:25.991608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1232/2441] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:25 2022] PUT /identity/v3/projects/229a3754823644dfac3348c5da219074/users/ca75c14f140343f9b56e685ea4e14c1a/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:26.002794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.003090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.003379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.029530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] MFA Rules not processed for user `ca75c14f140343f9b56e685ea4e14c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:26.031392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:26.097423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1210/2442] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:26.102227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:26.167703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73216b-b3b3-4ff0-ba2f-92df02deb3b2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:26.173571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:26.174134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.174465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.174781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.175445 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:26.177348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:26.355194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1233/2443] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:26 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:26.359762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:26.371767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f3d2-01f1-4e36-8b1b-815731e0f371 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:26.430363 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:26.431082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.431362 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.431637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.432351 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:26.434241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:26.534844 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1211/2444] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:26 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:26.539206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:26.549680 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c05254-6d89-4f39-8e4c-864dc2fce575 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:26.554373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:26.555073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.555354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.555657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.556422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:26.558010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:26.568799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1234/2445] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:26.573214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:26.584912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba2132-29d5-4076-a28f-8fd17e87e3ce admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:26.589804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:26.590746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.591030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.591309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] PATH_INFO: `/v3/projects/c5ad91aa889e4e92ae2293336b315485/users/bd58ca3a556745d8b2bb0fa985c27e17/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.607820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ad91aa889e4e92ae2293336b315485, user_id=bd58ca3a556745d8b2bb0fa985c27e17, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:26.610456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:26.615366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:26.701737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1212/2446] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:26 2022] PUT /identity/v3/projects/c5ad91aa889e4e92ae2293336b315485/users/bd58ca3a556745d8b2bb0fa985c27e17/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:26.706075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:26.716974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badbf52-c1e9-4202-9362-8696e78b8ac0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:26.804176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917bfd-bab4-4e86-8259-1e3d2319575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:26.804890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917bfd-bab4-4e86-8259-1e3d2319575e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.805181 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917bfd-bab4-4e86-8259-1e3d2319575e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.805468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917bfd-bab4-4e86-8259-1e3d2319575e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.806203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917bfd-bab4-4e86-8259-1e3d2319575e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:26.808411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917bfd-bab4-4e86-8259-1e3d2319575e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:26.829734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1235/2447] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:26.833602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:26.847505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75213-d793-4535-8fa8-36ad07b63b57 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:26.867668 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:26.868799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.869309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.869713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] PATH_INFO: `/v3/projects/c5ad91aa889e4e92ae2293336b315485/users/bd58ca3a556745d8b2bb0fa985c27e17/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.872136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ad91aa889e4e92ae2293336b315485, user_id=bd58ca3a556745d8b2bb0fa985c27e17, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:26.884923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:26.895729 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1213/2448] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:26 2022] PUT /identity/v3/projects/c5ad91aa889e4e92ae2293336b315485/users/bd58ca3a556745d8b2bb0fa985c27e17/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:26.908393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:26.913496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:26.913496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:26.946306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] MFA Rules not processed for user `bd58ca3a556745d8b2bb0fa985c27e17`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:26.948555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:26.978971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:27.017170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:27.018992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:27.029473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1236/2449] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:27.040339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:27.041764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:27.101913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ff3a-35c0-4acd-aeb1-ff1301c8306e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:27.105762 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:27.106402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:27.106616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeebb3-488d-4aec-9d27-3a44ec5cfd5c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:27.106735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:27.106986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:27.113476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:27.114186 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:27.115559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:27.115559 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:27.116850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:27.117415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:27.118887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:27.130240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1237/2450] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:27.148133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:27.148133 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219a630-4f49-45b9-871c-1e1a6f90283c service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:27.151986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1214/2451] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:27.664737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:27.728296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466792f3-5241-462e-8c4d-4678130b4ed4 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:27.733201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:27.734894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:27.735557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:27.736127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] PATH_INFO: `/v3/users/ca75c14f140343f9b56e685ea4e14c1a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:27.737586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca75c14f140343f9b56e685ea4e14c1a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:27.740826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:27.974849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca75c14f140343f9b56e685ea4e14c1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:27.975569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca75c14f140343f9b56e685ea4e14c1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.049781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca75c14f140343f9b56e685ea4e14c1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.050828 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca75c14f140343f9b56e685ea4e14c1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.053011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:28.064689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca75c14f140343f9b56e685ea4e14c1a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.070685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1238/2452] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:27 2022] DELETE /identity/v3/users/ca75c14f140343f9b56e685ea4e14c1a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:28.075142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:28.075663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:28.075762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:28.092973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:28.094177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:28.157445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1215/2453] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:28.168814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:28.169963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:28.234567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d499c9-4b1c-4940-8c6b-3a57665131c5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:28.240227 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:28.240892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:28.241225 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:28.241506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:28.252244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:28.256513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:28.263886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1239/2454] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:28.370112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:28.381198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266aa39-9113-4170-9ff2-15d2da7db1cd None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:28.384979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:28.385626 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:28.385910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:28.386190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:28.388013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:28.409765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:28.411256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:28.422287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1216/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:28.770304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:28.774973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:28.788223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2433-bc8a-490d-b152-ab1d0ab24210 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:28.793426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:28.794479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:28.794939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:28.795272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] PATH_INFO: `/v3/projects/229a3754823644dfac3348c5da219074` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:28.797649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229a3754823644dfac3348c5da219074)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:28.799702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:28.903168 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229a3754823644dfac3348c5da219074', 'request_id': 'req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.909576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229a3754823644dfac3348c5da219074', 'request_id': 'req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.985169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229a3754823644dfac3348c5da219074', 'request_id': 'req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.997750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] The token cache is being invalidate because project 229a3754823644dfac3348c5da219074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:28.998133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:28.999427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:29.001319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1240/2456] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:28 2022] DELETE /identity/v3/projects/229a3754823644dfac3348c5da219074 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:29.005365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:29.015694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ae27-720e-4af6-8546-ed99f97aeaad service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:29.071568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:29.084140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:29.085093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:29.085383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:29.086188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] PATH_INFO: `/v3/users/bd58ca3a556745d8b2bb0fa985c27e17` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:29.087555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd58ca3a556745d8b2bb0fa985c27e17)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:29.093978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:29.367046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd58ca3a556745d8b2bb0fa985c27e17'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:29.371148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd58ca3a556745d8b2bb0fa985c27e17'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:29.382763 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd58ca3a556745d8b2bb0fa985c27e17'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:29.444545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd58ca3a556745d8b2bb0fa985c27e17'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:29.457411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9b1b107d-21b3-4467-bbe4-6ece98e6e21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd58ca3a556745d8b2bb0fa985c27e17'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:29.463411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1217/2457] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:29 2022] DELETE /identity/v3/users/bd58ca3a556745d8b2bb0fa985c27e17 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:30.378868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:30.380429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:30.400972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883d28f-2cd1-4618-91b8-d16d7bdd6ca3 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:30.500264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:30.501723 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:30.502007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:30.502326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] PATH_INFO: `/v3/projects/c5ad91aa889e4e92ae2293336b315485` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:30.504551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ad91aa889e4e92ae2293336b315485)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:30.511813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:30.534204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:30.682937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ad91aa889e4e92ae2293336b315485', 'request_id': 'req-66bc52e5-435c-48d9-82ca-1546f29c1a4a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:30.689709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ad91aa889e4e92ae2293336b315485', 'request_id': 'req-66bc52e5-435c-48d9-82ca-1546f29c1a4a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:30.786465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ad91aa889e4e92ae2293336b315485', 'request_id': 'req-66bc52e5-435c-48d9-82ca-1546f29c1a4a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:30.801143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] The token cache is being invalidate because project c5ad91aa889e4e92ae2293336b315485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:30.801833 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:30.802673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-66bc52e5-435c-48d9-82ca-1546f29c1a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:30.805200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1241/2458] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:30 2022] DELETE /identity/v3/projects/c5ad91aa889e4e92ae2293336b315485 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:30.810169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:30.811316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:30.811803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:30.831776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:30.833146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:30.906766 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1218/2459] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:30.915995 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:30.916420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:30.916795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:30.950946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:30.952530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:30.967143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1242/2460] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:30.968974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:30.982571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78453d41-cf1d-4aa6-a744-ab24988efe7f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:30.991404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:30.993827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:30.993827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:30.993827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:30.993827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:30.994194 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:30.995979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.015101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1219/2461] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:31.016706 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.029275 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744adfce-42a4-4872-9425-25026f3baac7 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.039569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.039569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.039569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.039919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.040678 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.042742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.194626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1243/2462] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:31 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:31.196773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.207932 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a9e1-4123-4fd2-83fc-9695c588e2ea admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.271453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.272157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.272560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.272837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.273519 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.281229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.292568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:31.382840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1220/2463] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:31 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:31.386817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.398074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874f13c-f501-4e2d-bfce-5ea3ae8797c4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.403362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.404208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.404599 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.404953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.406438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.408203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.419580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1244/2464] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:31.424229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.434544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2202f17-43e4-4740-aa33-62010aa6d5d7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.440071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.440629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.440979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.441326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.444990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.444990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.476691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1221/2465] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:31.482904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.495685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e978-08ea-4254-89a4-affe6767e1b4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.522182 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ae69d-c0a2-4c18-ab03-4873b42e674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.523197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ae69d-c0a2-4c18-ab03-4873b42e674a admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.523682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ae69d-c0a2-4c18-ab03-4873b42e674a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.524233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ae69d-c0a2-4c18-ab03-4873b42e674a admin admin] PATH_INFO: `/v3/projects/7413182bf22440a989f3d318f0d3226e/users/14efc91e8a274d50b3b1b08d00b206ca/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.547773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ae69d-c0a2-4c18-ab03-4873b42e674a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7413182bf22440a989f3d318f0d3226e, user_id=14efc91e8a274d50b3b1b08d00b206ca, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.551517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ae69d-c0a2-4c18-ab03-4873b42e674a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.602089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.605661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:31.676620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6184b99-cee5-4752-8f66-7b00cbcac2d9 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.680530 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.681174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.681399 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.685575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.687029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:31.692868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1245/2466] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:31 2022] PUT /identity/v3/projects/7413182bf22440a989f3d318f0d3226e/users/14efc91e8a274d50b3b1b08d00b206ca/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:31.697575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.699085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.703823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.705060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.708765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.709535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1222/2467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:31.711816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.713277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:31.734373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f486aa9-e274-4c25-9363-1b7a89712e53 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.740533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] MFA Rules not processed for user `14efc91e8a274d50b3b1b08d00b206ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:31.741906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:31.822961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.823866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.824521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.824786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] PATH_INFO: `/v3/users/eb23dca9e4ac43b29987b39acd7b75ef` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.827695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb23dca9e4ac43b29987b39acd7b75ef)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.830346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.837156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1246/2468] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:31.841657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:31.865210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5640d6-4342-4293-8583-bc8885b9b3ca None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:31.872426 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:31.873463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:31.873953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:31.874516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:31.875736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:31.877976 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:31.992882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1247/2469] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:31 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:31.997237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:32.069258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe1a9-2d0a-4b3a-91cc-2906de0642d5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:32.071990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:32.075612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a16bc5-cce8-4ea0-95d3-922defb8de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:32.076352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a16bc5-cce8-4ea0-95d3-922defb8de73 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.076686 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a16bc5-cce8-4ea0-95d3-922defb8de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.080447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a16bc5-cce8-4ea0-95d3-922defb8de73 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.080447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a16bc5-cce8-4ea0-95d3-922defb8de73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:32.080447 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a16bc5-cce8-4ea0-95d3-922defb8de73 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:32.117142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb23dca9e4ac43b29987b39acd7b75ef'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:32.117943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb23dca9e4ac43b29987b39acd7b75ef'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:32.127334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb23dca9e4ac43b29987b39acd7b75ef'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:32.192142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1248/2470] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:31 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:32.193830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b464f-ce0c-416c-9504-4ccf9c3d5fb1 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.194122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b464f-ce0c-416c-9504-4ccf9c3d5fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.194402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b464f-ce0c-416c-9504-4ccf9c3d5fb1 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.196898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1249/2471] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 12:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:02:32.197640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b464f-ce0c-416c-9504-4ccf9c3d5fb1 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:32.220730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b464f-ce0c-416c-9504-4ccf9c3d5fb1 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:32.226394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e670d1-4ebe-4330-8263-aabed9ab20f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:32.227301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e670d1-4ebe-4330-8263-aabed9ab20f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.227778 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e670d1-4ebe-4330-8263-aabed9ab20f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.228205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e670d1-4ebe-4330-8263-aabed9ab20f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.229550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e670d1-4ebe-4330-8263-aabed9ab20f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:32.231670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e670d1-4ebe-4330-8263-aabed9ab20f3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:32.248023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1250/2472] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:32.252109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12667f0-f6e3-4f1b-b9b6-e79ef4cc56c9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.252400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12667f0-f6e3-4f1b-b9b6-e79ef4cc56c9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.252689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12667f0-f6e3-4f1b-b9b6-e79ef4cc56c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.272660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-b12667f0-f6e3-4f1b-b9b6-e79ef4cc56c9 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:32.273915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b12667f0-f6e3-4f1b-b9b6-e79ef4cc56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.285802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb23dca9e4ac43b29987b39acd7b75ef'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:32.305938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb23dca9e4ac43b29987b39acd7b75ef'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:32.321209 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1223/2473] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:31 2022] DELETE /identity/v3/users/eb23dca9e4ac43b29987b39acd7b75ef => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:32.322306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:32.324799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.395946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1251/2474] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:32.402771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.402948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:32.403142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.403142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.426423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93dd50-8ac4-48d0-b879-4de2d5b6a4df admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:32.429738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:32.430932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.432878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:32.433754 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.434218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.434848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.435578 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:32.437761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:32.440608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1252/2475] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:32.444600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:32.444600 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.453947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1224/2476] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:32.453947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:32.454477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.516358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077a84-0d3c-4c70-abe7-64d80270ff73 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:32.523072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2069-2cac-40e7-bb68-d8a400373551 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:32.523985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2069-2cac-40e7-bb68-d8a400373551 service glance] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.524147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fafeba-85ea-4128-91c6-8841ad80bb50 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:32.524574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2069-2cac-40e7-bb68-d8a400373551 service glance] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.524892 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2069-2cac-40e7-bb68-d8a400373551 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.528055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:32.528700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.529023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.529310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.546511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:32.546511 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:32.558655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1225/2477] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:32.559544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:32.578860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374afa0-39a9-4b0f-8e95-dafa4b186554 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:32.581897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c739-5e30-46bc-84a2-fa011e1d921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:32.582908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c739-5e30-46bc-84a2-fa011e1d921d admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.583656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c739-5e30-46bc-84a2-fa011e1d921d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.584033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c739-5e30-46bc-84a2-fa011e1d921d admin admin] PATH_INFO: `/v3/projects/e7eb30215e174584a3bac7594645c115/users/22d8416612dd44eeab30cc80ad04ffdb/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.618725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c739-5e30-46bc-84a2-fa011e1d921d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7eb30215e174584a3bac7594645c115, user_id=22d8416612dd44eeab30cc80ad04ffdb, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:32.619093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db2069-2cac-40e7-bb68-d8a400373551 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:32.622525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c739-5e30-46bc-84a2-fa011e1d921d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:32.627519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db2069-2cac-40e7-bb68-d8a400373551 service glance] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:32.652198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1253/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:32.757112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1226/2479] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:32 2022] PUT /identity/v3/projects/e7eb30215e174584a3bac7594645c115/users/22d8416612dd44eeab30cc80ad04ffdb/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:32.768328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.768328 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.768693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.823652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] MFA Rules not processed for user `22d8416612dd44eeab30cc80ad04ffdb`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:32.826835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.909699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458862a-4859-4146-89c4-d675f88133df None None] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.909699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458862a-4859-4146-89c4-d675f88133df None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.909699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458862a-4859-4146-89c4-d675f88133df None None] PATH_INFO: `/` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.911702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1227/2480] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 12:02:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:02:32.916694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:32.917449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:32.918118 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:32.950915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] MFA Rules not processed for user `9a7608c1ceb64497b74bd532e051aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:32.952929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:32.966575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1254/2481] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:32.966575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.029279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1228/2482] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:33.043098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.043098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.060796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002b01-8dfd-4bf5-8fb3-940ed1889766 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.066443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.067149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.071677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.071677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.071677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.071677 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.112121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6443-3a6b-4e1c-b852-f771df6c4fff None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.119661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.119661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.119661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.119661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] PATH_INFO: `/v3/users/daeda01f27034ddcafe45bd8f7d15a24` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.120812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=daeda01f27034ddcafe45bd8f7d15a24)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.122725 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.160317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1255/2483] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:32 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:33.160317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.225171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0305f-6e9e-4eca-a126-95d1c481d430 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.230418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.231101 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.231490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.233047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.241594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.243663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.255533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1256/2484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:33.256129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.263825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.349187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac059d-1152-4a52-ab37-1e1b94679b60 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.353403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.354071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daeda01f27034ddcafe45bd8f7d15a24'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.354550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.354885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.355003 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daeda01f27034ddcafe45bd8f7d15a24'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.355184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] PATH_INFO: `/v3/projects/0e66f4f7eec64abb828b50a9f702b611` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.356577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e66f4f7eec64abb828b50a9f702b611)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.359732 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.363820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daeda01f27034ddcafe45bd8f7d15a24'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.368367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:33.468095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daeda01f27034ddcafe45bd8f7d15a24'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.481704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daeda01f27034ddcafe45bd8f7d15a24'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.487633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e66f4f7eec64abb828b50a9f702b611', 'request_id': 'req-5e5bff99-24c5-429d-988e-975d29b944d1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.488499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1229/2485] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:33 2022] DELETE /identity/v3/users/daeda01f27034ddcafe45bd8f7d15a24 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:33.489267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.491546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.494313 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e66f4f7eec64abb828b50a9f702b611', 'request_id': 'req-5e5bff99-24c5-429d-988e-975d29b944d1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.558070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0528e8-45ac-4a2f-a545-842698bb55cd admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.562883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb409e-9d23-4bfc-8a1b-ef563e7aa557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.563549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb409e-9d23-4bfc-8a1b-ef563e7aa557 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.563832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb409e-9d23-4bfc-8a1b-ef563e7aa557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.564107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb409e-9d23-4bfc-8a1b-ef563e7aa557 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.564817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb409e-9d23-4bfc-8a1b-ef563e7aa557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.566836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb409e-9d23-4bfc-8a1b-ef563e7aa557 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.567937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e66f4f7eec64abb828b50a9f702b611', 'request_id': 'req-5e5bff99-24c5-429d-988e-975d29b944d1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.580099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] The token cache is being invalidate because project 0e66f4f7eec64abb828b50a9f702b611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:33.580394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.581055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5e5bff99-24c5-429d-988e-975d29b944d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.585490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1257/2486] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:33 2022] DELETE /identity/v3/projects/0e66f4f7eec64abb828b50a9f702b611 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:33.585490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5975-8415-4dbe-98c9-096f022530f8 None None] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.585490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5975-8415-4dbe-98c9-096f022530f8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.585490 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5975-8415-4dbe-98c9-096f022530f8 None None] PATH_INFO: `/` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.586467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1258/2487] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jun 16 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:02:33.587350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5975-8415-4dbe-98c9-096f022530f8 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.588891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4f4d5975-8415-4dbe-98c9-096f022530f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.604797 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5975-8415-4dbe-98c9-096f022530f8 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.610284 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.611197 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.611493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.611796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] PATH_INFO: `/v3/users/ebf94acbb7654511a3b970edb640f991` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.613092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf94acbb7654511a3b970edb640f991)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.615120 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.650601 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1230/2488] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:33 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:33.651952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.652263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.652570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.673495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] MFA Rules not processed for user `3ad599a6997f44dbb42472277cba7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:33.675016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.690004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:33.746354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1231/2489] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jun 16 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:33.747306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.748627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.763689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4b19d-7bf3-49f6-8dfe-91134fbc1b92 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.768893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.773497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.773497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.773497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.773497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.773497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.782800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1232/2490] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:33.783608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.785228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.798106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c2ab-b6be-45ba-a149-404d1fdbb331 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:33.802789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:33.803627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:33.803946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:33.804179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] PATH_INFO: `/v3/projects/478c248cfa7d4f2eaf4e2cc3440bf8da` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:33.805383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478c248cfa7d4f2eaf4e2cc3440bf8da)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:33.807306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:33.807421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf94acbb7654511a3b970edb640f991'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.807992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf94acbb7654511a3b970edb640f991'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.873035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf94acbb7654511a3b970edb640f991'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.880972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf94acbb7654511a3b970edb640f991'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.892709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf94acbb7654511a3b970edb640f991'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.898736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1259/2491] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:33 2022] DELETE /identity/v3/users/ebf94acbb7654511a3b970edb640f991 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:33.900508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:33.901786 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:33.924080 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478c248cfa7d4f2eaf4e2cc3440bf8da', 'request_id': 'req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.930863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478c248cfa7d4f2eaf4e2cc3440bf8da', 'request_id': 'req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:33.966107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8bf0b-ecba-41ce-a0ce-503d153eecaf admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.007572 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478c248cfa7d4f2eaf4e2cc3440bf8da', 'request_id': 'req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.015750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.016403 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.016687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.016964 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.018905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.019543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] The token cache is being invalidate because project 478c248cfa7d4f2eaf4e2cc3440bf8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:34.019864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.020524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.022053 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1233/2492] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:33 2022] DELETE /identity/v3/projects/478c248cfa7d4f2eaf4e2cc3440bf8da => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:34.022886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.024145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.086550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3589a-50e7-4a0b-8f56-23fc2b5cd1b1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.091075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.091593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.094512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.094670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d292bf-d845-42fe-8353-814042019d8c service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.094774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.094774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] PATH_INFO: `/v3/projects/a98048e1d1084eb2ba9824036b35ff5e/users/61803a14ed30419b9499969f1ccb4c2e/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.105118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1260/2493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:34.107354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ba114-21bf-4375-a1d2-813fec130af1 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.107842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ba114-21bf-4375-a1d2-813fec130af1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.108987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ba114-21bf-4375-a1d2-813fec130af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.112633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98048e1d1084eb2ba9824036b35ff5e, user_id=61803a14ed30419b9499969f1ccb4c2e, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.115942 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.145353 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-774ba114-21bf-4375-a1d2-813fec130af1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:34.147029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-774ba114-21bf-4375-a1d2-813fec130af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.158311 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1261/2494] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:34.166280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.166684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.167035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.189710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:34.191064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.193046 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1234/2495] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:34 2022] PUT /identity/v3/projects/a98048e1d1084eb2ba9824036b35ff5e/users/61803a14ed30419b9499969f1ccb4c2e/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:34.193968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.196423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.272479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223dc9-d8b4-4f90-8a0c-b590359244d0 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.275193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1262/2496] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:34.275193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.286687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.286687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.286687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.286687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.287083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.288065 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657114c-9ca6-475e-8d55-1c9474c2afcf None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.293037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.293699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.293984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.294242 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.294348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.295041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.296485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.297192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.306324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1235/2497] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:34.307217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.307341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1263/2498] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:34.314157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.319845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a00d-cdea-43a0-a21a-9cc0ac9750dc service placement] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.324136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6722-a447-4ab7-ac50-aa9e1ecb695e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.324991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.325762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.326057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.326332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.327238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:34.328176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.329533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ff3be-e168-44be-af21-49c07342c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.329772 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.330609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ff3be-e168-44be-af21-49c07342c425 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.330997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ff3be-e168-44be-af21-49c07342c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.331386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ff3be-e168-44be-af21-49c07342c425 admin admin] PATH_INFO: `/v3/projects/a98048e1d1084eb2ba9824036b35ff5e/users/61803a14ed30419b9499969f1ccb4c2e/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.333838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ff3be-e168-44be-af21-49c07342c425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98048e1d1084eb2ba9824036b35ff5e, user_id=61803a14ed30419b9499969f1ccb4c2e, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.336605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ff3be-e168-44be-af21-49c07342c425 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.343642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1236/2499] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:34.347922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.353870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1264/2500] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:34 2022] PUT /identity/v3/projects/a98048e1d1084eb2ba9824036b35ff5e/users/61803a14ed30419b9499969f1ccb4c2e/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:34.359366 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962f92d-2a12-4855-b5fb-f62939e878cc admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.359948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:34.366673 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.370624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.370624 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.400917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] MFA Rules not processed for user `61803a14ed30419b9499969f1ccb4c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:34.402142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.430029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.431957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.431957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.431957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.432212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.443805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.492229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:34.494739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1265/2501] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:34.494739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.496848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.510821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d040-0201-4dc3-9ff9-b197210ac4ad None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.516031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.516939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.517193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.517473 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] PATH_INFO: `/v3/projects/e963ac83c26b4d9396b05d2eceb79169` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.518707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e963ac83c26b4d9396b05d2eceb79169)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.520634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.586488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1237/2502] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:34.586488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.586488 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.646394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c7b8-3250-4270-a89c-84151ff34fd1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.650150 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e963ac83c26b4d9396b05d2eceb79169', 'request_id': 'req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.655853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e963ac83c26b4d9396b05d2eceb79169', 'request_id': 'req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.694384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.695052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.695333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.695602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.697415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.734223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e963ac83c26b4d9396b05d2eceb79169', 'request_id': 'req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.746379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] The token cache is being invalidate because project e963ac83c26b4d9396b05d2eceb79169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:34.746711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.747382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:34.749623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1266/2503] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:34 2022] DELETE /identity/v3/projects/e963ac83c26b4d9396b05d2eceb79169 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:34.750534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.752060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.760343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.761803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6ed06-d1b8-4e55-8095-ce6962c4c894 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.771979 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1238/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:34.783123 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34427-f437-4089-b4de-a75426e92d0d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.783455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34427-f437-4089-b4de-a75426e92d0d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.783698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34427-f437-4089-b4de-a75426e92d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.809501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-15b34427-f437-4089-b4de-a75426e92d0d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:34.811099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-15b34427-f437-4089-b4de-a75426e92d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.841696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fd20-c4eb-44c9-abb6-c611ecefba23 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.847075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.847737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.848023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.848310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.849015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.850989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.893506 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1239/2505] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:34.896713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.896713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.896713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.899594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:34.914505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:34.915777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:34.924462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1240/2506] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:34.928756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.938425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6688-883e-40d9-828f-1c86391f5eee None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.943016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.943787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.944066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.944348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.945052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:34.945350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.947077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.951793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1267/2507] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:34.958043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.967409 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1241/2508] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:02:34.968360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:34.969547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db2cc-eca5-4291-9061-756575b0ad12 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.976509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.977179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.977467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.977750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.978492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.980115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c43b-661e-4c7b-b1d9-b4869a713ce2 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:34.983017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.986436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:34.987345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:34.987486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:34.987686 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:34.988320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:34.990258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:34.990856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1268/2509] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:34.994526 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.006069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6868-31fc-4522-a8c8-9384f30c6513 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.011663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.011663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.011927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.012074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.012800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.015362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:35.028831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1269/2510] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:35.033023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.043216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f1e5-7199-4f68-99d4-64fe72d33180 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.048080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d02b5-a95a-4458-bffa-8cb9237cbfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.048952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d02b5-a95a-4458-bffa-8cb9237cbfe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.049239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d02b5-a95a-4458-bffa-8cb9237cbfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.049518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d02b5-a95a-4458-bffa-8cb9237cbfe6 admin admin] PATH_INFO: `/v3/projects/723b117423984f4297fe3b3f6f10416e/users/989bc117bfb841b5b06fe0a54e37e7b0/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.066005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d02b5-a95a-4458-bffa-8cb9237cbfe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723b117423984f4297fe3b3f6f10416e, user_id=989bc117bfb841b5b06fe0a54e37e7b0, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.073472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d02b5-a95a-4458-bffa-8cb9237cbfe6 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:35.100929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1242/2511] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:34 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:35.102244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.163618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624ef49-4dc9-439f-bb29-b4b2fb9f855b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.168410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.168987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.169270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.169546 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.170226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.173048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:35.192925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1270/2512] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:35 2022] PUT /identity/v3/projects/723b117423984f4297fe3b3f6f10416e/users/989bc117bfb841b5b06fe0a54e37e7b0/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:35.203114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.203424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.204665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.213836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:35.234940 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] MFA Rules not processed for user `989bc117bfb841b5b06fe0a54e37e7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:35.236177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:35.276594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1243/2513] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:35 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:35.281491 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.291438 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6830336-df83-4cc1-8442-5ccfa94b8bcc admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.312990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1271/2514] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:35.320935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.322392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:35.361628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.362295 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.366229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.366229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.366229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.366740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:35.377877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1244/2515] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:35.381996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.393967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00786c7-591a-4cc3-a137-c754fb81477b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.398713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.399423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.399778 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.400269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.400960 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.402611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:35.413507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1245/2516] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:35.427207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:35.427469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165df2f1-b95d-4e1d-9504-b56b27895523 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.428371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf888e07-6120-4396-9334-f5f69bad0e8f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:35.429131 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46ea6b-cfa6-425f-8f80-b82f2b3c7be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.429769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46ea6b-cfa6-425f-8f80-b82f2b3c7be2 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.430059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46ea6b-cfa6-425f-8f80-b82f2b3c7be2 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.430338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46ea6b-cfa6-425f-8f80-b82f2b3c7be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.433696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:35.434738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:35.435182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:35.435439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] PATH_INFO: `/v3/projects/e8d440f2d9b447f2b20872e5216c2709/users/05e5afe514b14cc8b7a01bee46f1bb41/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:35.439493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46ea6b-cfa6-425f-8f80-b82f2b3c7be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.441178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46ea6b-cfa6-425f-8f80-b82f2b3c7be2 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:35.450547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1272/2517] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:35.457114 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d440f2d9b447f2b20872e5216c2709, user_id=05e5afe514b14cc8b7a01bee46f1bb41, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:35.459857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.008239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1246/2518] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:35 2022] PUT /identity/v3/projects/e8d440f2d9b447f2b20872e5216c2709/users/05e5afe514b14cc8b7a01bee46f1bb41/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:36.019928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.020427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.020604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.033902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:36.050146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] MFA Rules not processed for user `05e5afe514b14cc8b7a01bee46f1bb41`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:36.051540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:36.117587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1273/2519] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:36.122124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.184554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5e2d3-e58e-4a1d-85b2-716e15d72346 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:36.189301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:36.189949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.190238 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.190520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.191246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:36.193145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.300493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1247/2520] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:36 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:36.306413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.315146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e09d-9d90-402a-a069-56b9e3da0d32 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:36.374728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:36.375418 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.375727 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.376010 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.376711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:36.378695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.480393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1274/2521] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:36 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:36.484944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.497415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ee84-7d89-4f51-b2a2-19f893a2e0d3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:36.504052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:36.504788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.505167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.505513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.506311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:36.508201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.525415 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1248/2522] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:36.526415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.538285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c260f-74f5-44b8-8d5b-26dd87d34302 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:36.543533 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:36.544597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.545653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.545937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] PATH_INFO: `/v3/projects/cdf9d60aeeae41e0940ff3690714f2f2/users/74f86e2540ca488cba0f506417f741de/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.563319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf9d60aeeae41e0940ff3690714f2f2, user_id=74f86e2540ca488cba0f506417f741de, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:36.566643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.665516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1275/2523] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:36 2022] PUT /identity/v3/projects/cdf9d60aeeae41e0940ff3690714f2f2/users/74f86e2540ca488cba0f506417f741de/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:36.669510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.681400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbbb1d-c65e-495b-9315-e10a44fe59aa admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:36.694009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:36.740745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d0cd-6af2-43d9-b149-42add0698aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:36.741556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d0cd-6af2-43d9-b149-42add0698aac admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.741843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d0cd-6af2-43d9-b149-42add0698aac admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.742121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d0cd-6af2-43d9-b149-42add0698aac admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.742877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689d0cd-6af2-43d9-b149-42add0698aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:36.744474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689d0cd-6af2-43d9-b149-42add0698aac admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.757896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1249/2524] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:36.759208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.770402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a0e74-8f75-45c2-b0a0-4b3a054ba0ec admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:36.775018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:36.776071 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.776295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.776563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] PATH_INFO: `/v3/projects/cdf9d60aeeae41e0940ff3690714f2f2/users/74f86e2540ca488cba0f506417f741de/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.778511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf9d60aeeae41e0940ff3690714f2f2, user_id=74f86e2540ca488cba0f506417f741de, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:36.781296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:36.791707 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1276/2525] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:36 2022] PUT /identity/v3/projects/cdf9d60aeeae41e0940ff3690714f2f2/users/74f86e2540ca488cba0f506417f741de/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:36.810112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:36.810531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:36.811035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:36.832809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:36.847651 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] MFA Rules not processed for user `74f86e2540ca488cba0f506417f741de`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:36.849785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:36.928377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1250/2526] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:36.941676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:36.944936 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.023765 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7493f-f094-41d7-8ab2-26fcc971b76f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:37.028577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:37.028577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.028577 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.029391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.043634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:37.046477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:37.059112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1277/2527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:37.127787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:37.192521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4f976-4f38-4f17-aec6-54146bafae45 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:37.197315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:37.198177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.198460 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.199189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] PATH_INFO: `/v3/users/05e5afe514b14cc8b7a01bee46f1bb41` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.200304 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e5afe514b14cc8b7a01bee46f1bb41)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:37.202827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:37.266876 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:37.268417 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.270666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:37.285844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201032a-e3b1-4b7d-bca2-2dfc9884587f service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:37.285844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:37.285844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.285844 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.286218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.286688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.347055 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:37.348497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62628436-07fd-4ae4-af7c-51c883475dfc service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:37.357578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1278/2528] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:37.358955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.359254 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.359540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.376654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:37.377868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.406246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e5afe514b14cc8b7a01bee46f1bb41'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:37.408904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e5afe514b14cc8b7a01bee46f1bb41'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:37.422888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e5afe514b14cc8b7a01bee46f1bb41'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:37.452505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1279/2529] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 12:02:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:37.460061 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:37.462285 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.493191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e5afe514b14cc8b7a01bee46f1bb41'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:37.507505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8afdc1b5-67d2-4a56-8435-044b25ba5c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e5afe514b14cc8b7a01bee46f1bb41'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:37.515497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1251/2530] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:37 2022] DELETE /identity/v3/users/05e5afe514b14cc8b7a01bee46f1bb41 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:37.519986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.520371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.520912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.540378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:37.540955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacfc5d-6735-4947-9512-fe11fcceed7a None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:37.542173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.606573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:37.607259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.607546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.607826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.608345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1252/2531] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:37.609744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.618780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:37.620302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.677567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:37.705543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a4f0-0485-4390-a8e3-d3b995b52ed3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:37.707341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:37.709552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:37.710469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:37.711890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.712187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.712480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.720553 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1280/2532] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 12:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:02:37.725105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:37.726982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:37.743516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1253/2533] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:02:37.839344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:37.840777 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.848394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:37.860063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3ba79-ad44-4804-9c27-b254ac917b51 service swift] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:37.864146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:37.864951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:37.865238 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:37.865519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:37.867565 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:37.893355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:37.895675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:37.906242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1281/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:38.555162 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:38.557323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:38.591813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf64-0fc6-47da-a696-a63efab34fde service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:38.597252 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:38.598406 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:38.598900 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:38.599280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] PATH_INFO: `/v3/projects/e8d440f2d9b447f2b20872e5216c2709` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:38.600476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d440f2d9b447f2b20872e5216c2709)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:38.603141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:38.664912 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:38.755417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d440f2d9b447f2b20872e5216c2709', 'request_id': 'req-59da2fcd-06c9-4466-9056-25eb43af424f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:38.773712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d440f2d9b447f2b20872e5216c2709', 'request_id': 'req-59da2fcd-06c9-4466-9056-25eb43af424f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:38.888343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:38.891205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d440f2d9b447f2b20872e5216c2709', 'request_id': 'req-59da2fcd-06c9-4466-9056-25eb43af424f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:38.916199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] The token cache is being invalidate because project e8d440f2d9b447f2b20872e5216c2709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:38.922783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:38.922783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:38.922783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1254/2535] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:38 2022] DELETE /identity/v3/projects/e8d440f2d9b447f2b20872e5216c2709 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:38.927277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:38.948763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8bf28-98ef-4d98-9e7e-15a8006bac22 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:39.084106 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:39.088634 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:39.088958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:39.089251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] PATH_INFO: `/v3/users/74f86e2540ca488cba0f506417f741de` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:39.090745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f86e2540ca488cba0f506417f741de)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:39.095046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:39.204486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:39.206690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:39.285859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2fcd-06c9-4466-9056-25eb43af424f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:39.290489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:39.291267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:39.291598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:39.291912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:39.293866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:39.350457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f86e2540ca488cba0f506417f741de'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:39.351759 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f86e2540ca488cba0f506417f741de'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:39.372057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:39.373512 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:39.383815 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1255/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:39.425059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f86e2540ca488cba0f506417f741de'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:39.435783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f86e2540ca488cba0f506417f741de'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:39.452983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-30b75e03-4186-41d1-8622-c2339ab6717a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f86e2540ca488cba0f506417f741de'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:39.459814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1282/2537] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:38 2022] DELETE /identity/v3/users/74f86e2540ca488cba0f506417f741de => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:39.506653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:39.762630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:39.804627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:40.002695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:40.004474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:40.039973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c99f-b1b3-445c-851e-b9258c92502a service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:40.193106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:40.194507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:40.194957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:40.195396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] PATH_INFO: `/v3/projects/cdf9d60aeeae41e0940ff3690714f2f2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:40.211110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf9d60aeeae41e0940ff3690714f2f2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:40.213259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:40.349030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf9d60aeeae41e0940ff3690714f2f2', 'request_id': 'req-5a167af8-03b5-4185-a148-776d28cf402b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:40.355726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf9d60aeeae41e0940ff3690714f2f2', 'request_id': 'req-5a167af8-03b5-4185-a148-776d28cf402b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:40.414717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf9d60aeeae41e0940ff3690714f2f2', 'request_id': 'req-5a167af8-03b5-4185-a148-776d28cf402b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:40.431596 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] The token cache is being invalidate because project cdf9d60aeeae41e0940ff3690714f2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:40.431850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:40.435227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-5a167af8-03b5-4185-a148-776d28cf402b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:40.439182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1256/2538] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:40 2022] DELETE /identity/v3/projects/cdf9d60aeeae41e0940ff3690714f2f2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:40.444996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:40.444996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:40.445386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:40.496217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:40.501470 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:40.504380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:40.617201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1283/2539] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:40.625553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:40.625843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:40.626116 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:40.652338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:40.654501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:40.664449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1257/2540] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:40.668811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:40.680069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66e09-6a80-415c-87b9-badd6736d6b8 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:40.686318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:40.687795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:40.688208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:40.688865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:40.689773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:40.690494 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:40.692268 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:40.707929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1284/2541] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:40.712599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:40.723137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a7b0-c78e-4ebf-963c-fcb34831ae33 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:40.728375 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:40.729108 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:40.729600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:40.729987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:40.730829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:40.732775 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:40.894801 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1258/2542] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:40 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:40.900036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:40.941271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c314d-10b9-4b31-a877-e80d9ee8bd63 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:41.031992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:41.032919 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.033366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.033818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.034963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:41.038015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:41.158647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1285/2543] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:40 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:41.164082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:41.180184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f9e4b-bd6c-4a29-93a1-535ccf4f064c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:41.189421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:41.189421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.189421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.189421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.189836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:41.197037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:41.218259 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1259/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:41.222326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:41.233843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db839-547d-40e6-9800-494527830658 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:41.239586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab70df-2b7d-48ec-a8aa-1dafcc6d79b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:41.239586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab70df-2b7d-48ec-a8aa-1dafcc6d79b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.240117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab70df-2b7d-48ec-a8aa-1dafcc6d79b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.240242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab70df-2b7d-48ec-a8aa-1dafcc6d79b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.241229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab70df-2b7d-48ec-a8aa-1dafcc6d79b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:41.243081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab70df-2b7d-48ec-a8aa-1dafcc6d79b2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:41.266751 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1286/2545] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:41.268220 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:41.288249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826ff9-a3d6-4631-a67f-773a064a797b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:41.291055 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:41.292739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.293856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.294291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] PATH_INFO: `/v3/projects/52390053e9ee42e8b7a95b3a9e40578b/users/d688468e3179470caa1193e3d1c6b408/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.326327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52390053e9ee42e8b7a95b3a9e40578b, user_id=d688468e3179470caa1193e3d1c6b408, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:41.329975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:41.452346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1260/2546] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:41 2022] PUT /identity/v3/projects/52390053e9ee42e8b7a95b3a9e40578b/users/d688468e3179470caa1193e3d1c6b408/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:41.460556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.461104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.461393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.477775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:41.503352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] MFA Rules not processed for user `d688468e3179470caa1193e3d1c6b408`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:41.504750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:41.610100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1287/2547] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:41.618641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:41.760369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0bf2-cb22-4a90-bbd3-363bb8cd3828 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:41.765915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:41.766632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.766918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.767207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.767917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:41.769974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:41.903476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1261/2548] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:41 2022] POST /identity/v3/projects => generated 377 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:41.907439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:41.921260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b29411-bf8c-44c0-ae70-defaf0733121 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:41.996944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:41.997610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:41.997944 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:41.998253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:41.999081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:42.001203 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:42.150281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1288/2549] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:41 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:42.154170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:42.168309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48639bd-17cc-416e-a5e9-c05c9c941be1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:42.174550 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:42.175434 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:42.175819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:42.176367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:42.177233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:42.179285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:42.198333 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1262/2550] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:42.203180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:42.216272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9bcb6-61f2-4163-a57f-5f594724488a admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:42.223734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:42.225210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:42.225566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:42.225852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] PATH_INFO: `/v3/projects/906ba81f2c0e4397b33f3c680aa5513b/users/579ce5f38e1a416aa5fb41bc7ecd9f3f/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:42.249299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906ba81f2c0e4397b33f3c680aa5513b, user_id=579ce5f38e1a416aa5fb41bc7ecd9f3f, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:42.253003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:42.353223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1289/2551] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:42 2022] PUT /identity/v3/projects/906ba81f2c0e4397b33f3c680aa5513b/users/579ce5f38e1a416aa5fb41bc7ecd9f3f/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:42.354829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:42.372961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b5c46-5aac-4d3a-af3e-6eb9dc04a657 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:42.445027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:42.487041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306cd15-9b09-4880-b0fe-9098e368a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:42.487850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306cd15-9b09-4880-b0fe-9098e368a0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:42.489032 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306cd15-9b09-4880-b0fe-9098e368a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:42.489515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306cd15-9b09-4880-b0fe-9098e368a0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:42.490345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306cd15-9b09-4880-b0fe-9098e368a0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:42.492393 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306cd15-9b09-4880-b0fe-9098e368a0d9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:42.507783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1263/2552] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:42.511864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:42.538397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b66c60-d092-471a-96a7-f23ea9ad3511 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:42.544967 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:42.546810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:42.547402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:42.547852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] PATH_INFO: `/v3/projects/906ba81f2c0e4397b33f3c680aa5513b/users/579ce5f38e1a416aa5fb41bc7ecd9f3f/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:42.550827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=906ba81f2c0e4397b33f3c680aa5513b, user_id=579ce5f38e1a416aa5fb41bc7ecd9f3f, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:42.554659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:42.581706 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:42.582378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:42.582845 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:42.584993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1290/2553] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:42 2022] PUT /identity/v3/projects/906ba81f2c0e4397b33f3c680aa5513b/users/579ce5f38e1a416aa5fb41bc7ecd9f3f/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:42.616994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] MFA Rules not processed for user `579ce5f38e1a416aa5fb41bc7ecd9f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:42.618226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:42.725317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1264/2554] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:42.734888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:42.737159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:42.805263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:42.817561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c01f1-9f39-434e-9c4b-835bfcef9bdb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:42.828906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df376-cbbe-4ee0-86bc-d9dc375b4d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:42.841455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df376-cbbe-4ee0-86bc-d9dc375b4d7c service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:42.841455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df376-cbbe-4ee0-86bc-d9dc375b4d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:42.841455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df376-cbbe-4ee0-86bc-d9dc375b4d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:42.867349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df376-cbbe-4ee0-86bc-d9dc375b4d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:42.869165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df376-cbbe-4ee0-86bc-d9dc375b4d7c service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:42.892916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1291/2555] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:43.007929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:43.007929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:43.112699 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79be92-b3f1-478d-b126-97428a5b78c6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:43.117570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:43.118493 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:43.118857 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:43.119059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] PATH_INFO: `/v3/users/989bc117bfb841b5b06fe0a54e37e7b0` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:43.127556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=989bc117bfb841b5b06fe0a54e37e7b0)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:43.130181 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:43.370471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989bc117bfb841b5b06fe0a54e37e7b0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:43.371215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989bc117bfb841b5b06fe0a54e37e7b0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:43.378455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989bc117bfb841b5b06fe0a54e37e7b0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:43.380428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:43.504830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989bc117bfb841b5b06fe0a54e37e7b0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:43.531048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989bc117bfb841b5b06fe0a54e37e7b0'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:43.547583 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1265/2556] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:43 2022] DELETE /identity/v3/users/989bc117bfb841b5b06fe0a54e37e7b0 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:43.553887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:43.554283 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:43.554448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:43.644811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:43.649345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:43.750122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1292/2557] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:43.760336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:43.762064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:43.838571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d212-e002-4ce8-b7e5-505f0a76f55a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:43.842782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:43.849477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:43.849477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:43.849477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:43.859997 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:43.861690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:43.883665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1266/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:44.193045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:44.195063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:44.311547 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f17a7-a5c5-45d7-841e-44ee7b0a5a15 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:44.318720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '579ce5f38e1a416aa5fb41bc7ecd9f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '906ba81f2c0e4397b33f3c680aa5513b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:44.319760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:44.320277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:44.320768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:44.322436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:44.323041 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:44.325650 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:44.348818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1293/2559] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:44.350874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:44.362755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084f9f-7497-45c6-ab2d-4bb94e3f1dbd service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:44.367716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '579ce5f38e1a416aa5fb41bc7ecd9f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '906ba81f2c0e4397b33f3c680aa5513b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:44.368465 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:44.374068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:44.374068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:44.374068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:44.374068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:44.477913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:44.477913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:44.494982 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0319b67-9601-4dfe-b75a-f4cf97a7ce34 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:44.512150 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1267/2560] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:44 2022] POST /identity/v3/projects => generated 354 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:44.520482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:44.523408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:44.524721 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:44.525315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:44.525885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] PATH_INFO: `/v3/projects/723b117423984f4297fe3b3f6f10416e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:44.527601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723b117423984f4297fe3b3f6f10416e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:44.530758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:44.633374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468255-4f24-45f4-8780-19391e43ba31 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:44.644243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '579ce5f38e1a416aa5fb41bc7ecd9f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '906ba81f2c0e4397b33f3c680aa5513b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:44.646008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:44.647025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:44.647663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:44.649072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:44.649667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:44.663436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:44.677374 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1268/2561] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:44.678098 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:44.689752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:44.691924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723b117423984f4297fe3b3f6f10416e', 'request_id': 'req-f4637a7a-9705-49c6-a9e3-a02c657a3124'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:44.704298 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723b117423984f4297fe3b3f6f10416e', 'request_id': 'req-f4637a7a-9705-49c6-a9e3-a02c657a3124'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:44.807009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:44.830074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83287-ee31-4a7c-9963-acc9267c485c tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:44.974695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:44.974695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:44.974695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:44.974695 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] PATH_INFO: `/v3/users/14efc91e8a274d50b3b1b08d00b206ca` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:44.975478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14efc91e8a274d50b3b1b08d00b206ca)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:44.975478 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:45.093992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723b117423984f4297fe3b3f6f10416e', 'request_id': 'req-f4637a7a-9705-49c6-a9e3-a02c657a3124'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.131305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] The token cache is being invalidate because project 723b117423984f4297fe3b3f6f10416e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:45.131305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.131305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.134645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1294/2562] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:44 2022] DELETE /identity/v3/projects/723b117423984f4297fe3b3f6f10416e => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:45.142530 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:45.144046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:45.154573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:45.222948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4637a7a-9705-49c6-a9e3-a02c657a3124 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:45.230962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '579ce5f38e1a416aa5fb41bc7ecd9f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '906ba81f2c0e4397b33f3c680aa5513b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:45.232349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.232838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.233467 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] PATH_INFO: `/v3/projects/d3e3a68e645e45fc907048f6b6562e1d` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.235434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d3e3a68e645e45fc907048f6b6562e1d)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:45.237983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:45.286196 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14efc91e8a274d50b3b1b08d00b206ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.287713 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14efc91e8a274d50b3b1b08d00b206ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.297376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14efc91e8a274d50b3b1b08d00b206ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.391697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14efc91e8a274d50b3b1b08d00b206ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.396959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e3a68e645e45fc907048f6b6562e1d', 'request_id': 'req-ced533eb-153b-49f7-a126-b07a35e2e6c9'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.403422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e3a68e645e45fc907048f6b6562e1d', 'request_id': 'req-ced533eb-153b-49f7-a126-b07a35e2e6c9'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.412455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-ed6eeeca-3c46-442b-93ea-c83584baaf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14efc91e8a274d50b3b1b08d00b206ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.419060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1269/2563] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:44 2022] DELETE /identity/v3/users/14efc91e8a274d50b3b1b08d00b206ca => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:45.420545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0955c4-f414-47e5-af80-de4b49fd87f8 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.420836 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0955c4-f414-47e5-af80-de4b49fd87f8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.421126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0955c4-f414-47e5-af80-de4b49fd87f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.448866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1b0955c4-f414-47e5-af80-de4b49fd87f8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:45.450105 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1b0955c4-f414-47e5-af80-de4b49fd87f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:45.489743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e3a68e645e45fc907048f6b6562e1d', 'request_id': 'req-ced533eb-153b-49f7-a126-b07a35e2e6c9'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.515066 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] The token cache is being invalidate because project d3e3a68e645e45fc907048f6b6562e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:45.516109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.517158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ced533eb-153b-49f7-a126-b07a35e2e6c9 tempest-VolumeQuotaClassesTest-16598915 tempest-VolumeQuotaClassesTest-16598915-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:45.519617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1295/2564] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:45 2022] DELETE /identity/v3/projects/d3e3a68e645e45fc907048f6b6562e1d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:45.521543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.521969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.522242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.526381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1270/2565] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:45.534660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.541349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.541349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.548424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:45.550630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:45.555665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:45.556872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:45.564114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1296/2566] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:45.578617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:45.587067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1271/2567] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:45.588956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:45.590995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:45.602063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed847e-0cb8-41d2-b632-a64def28bde0 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:45.607270 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:45.608591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.608953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.609299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.610110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:45.610536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:45.612378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:45.615445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:45.626353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1272/2568] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:45.631153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:45.642302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cecd2-d292-455d-99f1-c5d228d85324 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:45.652635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:45.652635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.652635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.652635 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.653100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:45.654573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:45.668127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdad1-8f5f-40f6-9467-ea8ca7b02805 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:45.680911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:45.694250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:45.694250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:45.694250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:45.703670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:45.705794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:45.718018 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1297/2569] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:46.034825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1273/2570] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:45 2022] POST /identity/v3/projects => generated 371 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:46.036043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.047100 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b273-6bf6-4dee-814b-5b5d8a693a40 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.081240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:46.109635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.110463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.110763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.111051 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.111754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.113728 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.229272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1298/2571] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:46 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:46.233427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.244299 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fa2a-0746-4c42-b7c3-36695f39f489 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.249533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.250193 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.250480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.250792 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.251571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.253120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.264171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1274/2572] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:46.270987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.278087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f353d-5bf0-416d-991a-a98328b1c033 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.282669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.283323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.283608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.283889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.284613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.286209 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.296322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1299/2573] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:46.302612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.312922 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec535f68-d669-4af8-902e-a425b286870c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.322390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a663a4-7427-4672-9748-5e2faa08c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.323385 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a663a4-7427-4672-9748-5e2faa08c7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.323670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a663a4-7427-4672-9748-5e2faa08c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.323945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a663a4-7427-4672-9748-5e2faa08c7b7 admin admin] PATH_INFO: `/v3/projects/bd8a2b20b5aa452ca3889913a7b18e27/users/e6ee8341034c4bb393f7c3d6b0258434/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.339560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a663a4-7427-4672-9748-5e2faa08c7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8a2b20b5aa452ca3889913a7b18e27, user_id=e6ee8341034c4bb393f7c3d6b0258434, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.342171 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a663a4-7427-4672-9748-5e2faa08c7b7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.382436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.384239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:46.397574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f8c0-6ee4-446e-b85c-c0dbf4fca92e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.402317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.403256 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.403545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.403826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] PATH_INFO: `/v3/projects/7413182bf22440a989f3d318f0d3226e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.405350 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7413182bf22440a989f3d318f0d3226e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.407083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.448317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1275/2574] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:46 2022] PUT /identity/v3/projects/bd8a2b20b5aa452ca3889913a7b18e27/users/e6ee8341034c4bb393f7c3d6b0258434/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:46.460396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.460732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.461020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.489782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] MFA Rules not processed for user `e6ee8341034c4bb393f7c3d6b0258434`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:46.491013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:46.533654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7413182bf22440a989f3d318f0d3226e', 'request_id': 'req-791b8e16-403e-4f82-8c80-030ab02bc7af'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.539034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7413182bf22440a989f3d318f0d3226e', 'request_id': 'req-791b8e16-403e-4f82-8c80-030ab02bc7af'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.557405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1276/2575] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:46.558344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.559658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:46.598472 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7413182bf22440a989f3d318f0d3226e', 'request_id': 'req-791b8e16-403e-4f82-8c80-030ab02bc7af'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.611845 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] The token cache is being invalidate because project 7413182bf22440a989f3d318f0d3226e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:46.612159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.612810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.614522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1300/2576] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:46 2022] DELETE /identity/v3/projects/7413182bf22440a989f3d318f0d3226e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:46.615314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.616621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:46.628455 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28c38-95cb-4410-88b7-22686b595b6e None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.660289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:46.681059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b8e16-403e-4f82-8c80-030ab02bc7af admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.684468 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.685655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.685655 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.685882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] PATH_INFO: `/v3/users/d688468e3179470caa1193e3d1c6b408` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.693695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.693869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d688468e3179470caa1193e3d1c6b408)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.693980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.693980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.693980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.693980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.694334 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.694425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.813990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1301/2577] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:46.813990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:46.815019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:46.876955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a231e-74f0-498d-b265-d8b85b47c7ea admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:46.882718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:46.887337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:46.887337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:46.887337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] PATH_INFO: `/v3/users/22d8416612dd44eeab30cc80ad04ffdb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:46.887337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d8416612dd44eeab30cc80ad04ffdb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:46.887337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:46.920708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd688468e3179470caa1193e3d1c6b408'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.921915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd688468e3179470caa1193e3d1c6b408'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:46.928962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd688468e3179470caa1193e3d1c6b408'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.024567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd688468e3179470caa1193e3d1c6b408'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.037356 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd688468e3179470caa1193e3d1c6b408'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.043211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1277/2578] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:46 2022] DELETE /identity/v3/users/d688468e3179470caa1193e3d1c6b408 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:47.047149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.047149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.096503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d8416612dd44eeab30cc80ad04ffdb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.097187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d8416612dd44eeab30cc80ad04ffdb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.111112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:47.117834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2282b-70d3-4e5f-b776-a94e4cedc501 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.122527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.123222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.124040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.124473 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.125693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.131279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.175174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d8416612dd44eeab30cc80ad04ffdb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.182713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d8416612dd44eeab30cc80ad04ffdb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.195649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03de0c1d-7491-41b3-b7f0-71cc98c2fdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d8416612dd44eeab30cc80ad04ffdb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:47.202853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1302/2579] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:46 2022] DELETE /identity/v3/users/22d8416612dd44eeab30cc80ad04ffdb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:47.206057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.206057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.206057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.223595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:47.224795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.235136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1278/2580] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:47 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:47.243666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.243666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.259111 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134b4c-66f6-472d-af1a-c90c340f57d6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.318504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1303/2581] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:47.334945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:47.337146 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.338945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.364746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.365413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.365869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.366287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.367125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.376018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.392533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1279/2582] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:47.395008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.407890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8790f-f100-4174-ac54-40d37d006486 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.414854 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.415846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.416279 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.416549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] PATH_INFO: `/v3/projects/fc8fe5aa05ab42dcabc7c17a74b13ccd/users/920ad3900202400185e7b7f900d16370/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.430927 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23054b64-c105-4701-ba51-1a3e4eb76cac None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.438626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.438626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.438626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.438626 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.444175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8fe5aa05ab42dcabc7c17a74b13ccd, user_id=920ad3900202400185e7b7f900d16370, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.447560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.466785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.466785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.470205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1304/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:47.543585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1280/2584] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:47 2022] PUT /identity/v3/projects/fc8fe5aa05ab42dcabc7c17a74b13ccd/users/920ad3900202400185e7b7f900d16370/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:47.547700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.560358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843b12-4860-4266-b85e-2ad9eb289cca service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.647492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf55ec-4c3d-4d0f-8fc5-431a0a714670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.648561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf55ec-4c3d-4d0f-8fc5-431a0a714670 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.648934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf55ec-4c3d-4d0f-8fc5-431a0a714670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.649319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf55ec-4c3d-4d0f-8fc5-431a0a714670 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.650782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf55ec-4c3d-4d0f-8fc5-431a0a714670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.652575 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf55ec-4c3d-4d0f-8fc5-431a0a714670 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.670383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.674872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1305/2585] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:47.682953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7f5bd-aa56-4674-940e-543d7f2657e1 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.689716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.690794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.691376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.691728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] PATH_INFO: `/v3/projects/fc8fe5aa05ab42dcabc7c17a74b13ccd/users/920ad3900202400185e7b7f900d16370/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.694028 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8fe5aa05ab42dcabc7c17a74b13ccd, user_id=920ad3900202400185e7b7f900d16370, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.697061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.709232 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1281/2586] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:47 2022] PUT /identity/v3/projects/fc8fe5aa05ab42dcabc7c17a74b13ccd/users/920ad3900202400185e7b7f900d16370/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:47.719524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.720073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.720073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.747938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] MFA Rules not processed for user `920ad3900202400185e7b7f900d16370`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:47.749868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.825476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1306/2587] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:47.837188 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.839095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.850400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:47.852468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:47.923164 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04f8ab-4643-41d1-a7ca-5f0ba884561d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.932083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.934283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.936213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.938544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.954977 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.955255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320caec-a7ff-4754-ae32-fce094fdc040 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:47.958017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.961544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:47.962542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:47.962998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:47.963380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] PATH_INFO: `/v3/projects/e7eb30215e174584a3bac7594645c115` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:47.964842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7eb30215e174584a3bac7594645c115)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:47.968063 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:47.972423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1282/2588] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:48.132969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:48.137395 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:48.184336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7eb30215e174584a3bac7594645c115', 'request_id': 'req-0657ce58-2d61-4352-a14e-42ff887e45c6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.191170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041cae8-bce4-41c1-b505-f51d0d64249d service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:48.200819 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7eb30215e174584a3bac7594645c115', 'request_id': 'req-0657ce58-2d61-4352-a14e-42ff887e45c6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.260643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:48.261516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:48.261813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:48.262075 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] PATH_INFO: `/v3/projects/52390053e9ee42e8b7a95b3a9e40578b` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:48.263394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52390053e9ee42e8b7a95b3a9e40578b)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:48.265531 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:48.333612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7eb30215e174584a3bac7594645c115', 'request_id': 'req-0657ce58-2d61-4352-a14e-42ff887e45c6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.347801 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] The token cache is being invalidate because project e7eb30215e174584a3bac7594645c115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:48.348373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.349180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.352448 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1307/2589] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:47 2022] DELETE /identity/v3/projects/e7eb30215e174584a3bac7594645c115 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:48.356506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:48.358640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:48.374053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657ce58-2d61-4352-a14e-42ff887e45c6 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:48.378688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:48.379556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:48.379836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:48.380111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] PATH_INFO: `/v3/users/61803a14ed30419b9499969f1ccb4c2e` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:48.381299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=61803a14ed30419b9499969f1ccb4c2e)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:48.383280 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:48.447885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52390053e9ee42e8b7a95b3a9e40578b', 'request_id': 'req-a379e875-d971-4825-a753-6eb0b6496921'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.455088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52390053e9ee42e8b7a95b3a9e40578b', 'request_id': 'req-a379e875-d971-4825-a753-6eb0b6496921'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.533413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52390053e9ee42e8b7a95b3a9e40578b', 'request_id': 'req-a379e875-d971-4825-a753-6eb0b6496921'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.536814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:48.549598 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] The token cache is being invalidate because project 52390053e9ee42e8b7a95b3a9e40578b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:48.550139 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.550610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.552566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1283/2590] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:48 2022] DELETE /identity/v3/projects/52390053e9ee42e8b7a95b3a9e40578b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:48.557287 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:48.559846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:48.647145 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61803a14ed30419b9499969f1ccb4c2e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.648248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61803a14ed30419b9499969f1ccb4c2e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.650794 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e875-d971-4825-a753-6eb0b6496921 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:48.659949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:48.661920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:48.662382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:48.662899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] PATH_INFO: `/v3/users/579ce5f38e1a416aa5fb41bc7ecd9f3f` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:48.664726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=579ce5f38e1a416aa5fb41bc7ecd9f3f)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:48.667538 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:48.758226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61803a14ed30419b9499969f1ccb4c2e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.765713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61803a14ed30419b9499969f1ccb4c2e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.777567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61803a14ed30419b9499969f1ccb4c2e'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.784109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1308/2591] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:48 2022] DELETE /identity/v3/users/61803a14ed30419b9499969f1ccb4c2e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:48.917896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579ce5f38e1a416aa5fb41bc7ecd9f3f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.918661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579ce5f38e1a416aa5fb41bc7ecd9f3f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.926443 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579ce5f38e1a416aa5fb41bc7ecd9f3f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:48.985553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:49.030621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579ce5f38e1a416aa5fb41bc7ecd9f3f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.049594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579ce5f38e1a416aa5fb41bc7ecd9f3f'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.082694 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1284/2592] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:48 2022] DELETE /identity/v3/users/579ce5f38e1a416aa5fb41bc7ecd9f3f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:49.365195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:49.366408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:49.455602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:49.457360 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:49.522326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693bb7-808b-4ca7-835c-2ec9257751ec admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:49.605091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4341e-f97a-4760-b9a7-a9f109e2a70f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:49.612910 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:49.614540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:49.615146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:49.615680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] PATH_INFO: `/v3/projects/a98048e1d1084eb2ba9824036b35ff5e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:49.616868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:49.617524 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98048e1d1084eb2ba9824036b35ff5e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:49.618523 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:49.618896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:49.619188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] PATH_INFO: `/v3/users/e6ee8341034c4bb393f7c3d6b0258434` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:49.620823 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:49.620952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ee8341034c4bb393f7c3d6b0258434)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:49.623015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:49.805142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98048e1d1084eb2ba9824036b35ff5e', 'request_id': 'req-3804aa6a-219b-4965-8964-7b23c5a8edcf'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.809372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ee8341034c4bb393f7c3d6b0258434'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.811097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ee8341034c4bb393f7c3d6b0258434'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.814477 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98048e1d1084eb2ba9824036b35ff5e', 'request_id': 'req-3804aa6a-219b-4965-8964-7b23c5a8edcf'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.886860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98048e1d1084eb2ba9824036b35ff5e', 'request_id': 'req-3804aa6a-219b-4965-8964-7b23c5a8edcf'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.901110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] The token cache is being invalidate because project a98048e1d1084eb2ba9824036b35ff5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:49.901400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.902063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.903681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1285/2593] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:49 2022] DELETE /identity/v3/projects/a98048e1d1084eb2ba9824036b35ff5e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:49.904442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:49.906291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:49.964233 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ee8341034c4bb393f7c3d6b0258434'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.973377 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ee8341034c4bb393f7c3d6b0258434'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.985339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804aa6a-219b-4965-8964-7b23c5a8edcf admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:49.988607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a4d6f3fe-945e-4497-86fa-2f2f99ee801d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ee8341034c4bb393f7c3d6b0258434'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:49.991539 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:49.992454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:49.992744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:49.993027 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] PATH_INFO: `/v3/projects/906ba81f2c0e4397b33f3c680aa5513b` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:49.994231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906ba81f2c0e4397b33f3c680aa5513b)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:49.995359 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1309/2594] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:49 2022] DELETE /identity/v3/users/e6ee8341034c4bb393f7c3d6b0258434 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:49.996182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:49.996612 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28826-4f21-4aa3-914c-ecb33f9350c0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:49.996904 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28826-4f21-4aa3-914c-ecb33f9350c0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:49.997184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28826-4f21-4aa3-914c-ecb33f9350c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.014645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-58c28826-4f21-4aa3-914c-ecb33f9350c0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:50.015850 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-58c28826-4f21-4aa3-914c-ecb33f9350c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.076282 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1310/2595] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:50.078329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fecea-c834-4f79-b588-cfed47673707 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.078649 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fecea-c834-4f79-b588-cfed47673707 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.078929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fecea-c834-4f79-b588-cfed47673707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.096113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-004fecea-c834-4f79-b588-cfed47673707 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:50.097376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-004fecea-c834-4f79-b588-cfed47673707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.105709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1311/2596] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:50.107070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.107355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.107630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.119835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906ba81f2c0e4397b33f3c680aa5513b', 'request_id': 'req-c95adc12-aaa2-4822-b46f-681d99e98203'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:50.125848 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906ba81f2c0e4397b33f3c680aa5513b', 'request_id': 'req-c95adc12-aaa2-4822-b46f-681d99e98203'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:50.127805 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:50.129169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.183320 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:50.188563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1312/2597] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:50.193789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.193789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.213462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906ba81f2c0e4397b33f3c680aa5513b', 'request_id': 'req-c95adc12-aaa2-4822-b46f-681d99e98203'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:50.225509 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] The token cache is being invalidate because project 906ba81f2c0e4397b33f3c680aa5513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:50.225800 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:50.226764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:50.228310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1286/2598] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:49 2022] DELETE /identity/v3/projects/906ba81f2c0e4397b33f3c680aa5513b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:50.229280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.230525 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.242881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95adc12-aaa2-4822-b46f-681d99e98203 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.247644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.248300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.249117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.249363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085225-27e3-4b54-94fd-09be2d2f2114 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.249467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.250101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:50.250412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.252068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d977a-a273-4903-8709-6401a9582335 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.253206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.253867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.256896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.256896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.256896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.267376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1287/2599] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:02:50.267376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb442-6032-4c91-bfe8-b2ec45bb2d85 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.267376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb442-6032-4c91-bfe8-b2ec45bb2d85 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.267376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb442-6032-4c91-bfe8-b2ec45bb2d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.268735 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.270163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.279629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1313/2600] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:50.280433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.284022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e99fb442-6032-4c91-bfe8-b2ec45bb2d85 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:50.285244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e99fb442-6032-4c91-bfe8-b2ec45bb2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.289749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ad31-b936-4e40-ba8b-5595d5b9c760 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.293644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1288/2601] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:50.294485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.295161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.296002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.296583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.297045 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.299043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.301834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.302125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.302760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.321380 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:50.322627 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.330670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1289/2602] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:50.334702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.343780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894fd80-ce6a-4e71-b72f-5607173ebb25 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.348594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.349248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.349533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.349813 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.350549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:50.350934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.352797 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.366712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1290/2603] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:02:50.370990 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.381708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a70c2-ddd7-43a2-83f2-76a3abea4d8f admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.386719 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.387370 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.387656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.387963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.388678 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.390756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.406772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1314/2604] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:50.409322 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.419109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:50.469524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f55790-07ff-49f9-97e8-fe637643eac8 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.474317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.478356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.478356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.478356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.478356 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.479160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.494018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1291/2605] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:50.499864 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.565774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372ad7-5a9b-4af9-aba5-e116afcdb503 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.583944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.583944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.583944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.583944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.584328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.584430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1315/2606] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:50.584532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.584629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.590891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7cfd1-e2ea-45eb-a4d3-80fd6081e47c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.599627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.600598 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.601872 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.602354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.603148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.604818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.615868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1316/2607] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:50.619656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.629672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ecc17-f9f8-40c5-8d89-df5ab6349888 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.634884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.635541 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.635823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.636126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.637214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.639004 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.650852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1317/2608] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:50.655811 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.665697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4ba4-db10-469a-807a-2a6487b206eb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.670330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.671305 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.671586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.671865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] PATH_INFO: `/v3/projects/5d765fb8a29d47588dd708a82feed705/users/1a3929c441774e1eaff37b865b7219d5/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.686776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d765fb8a29d47588dd708a82feed705, user_id=1a3929c441774e1eaff37b865b7219d5, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.689399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.710774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1292/2609] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:50.714704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.724289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4fe8-ff8c-45bb-b688-b7b65fcbbc85 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.728435 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:50.729433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.730140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.730540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.730886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.731860 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.733829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.748054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1293/2610] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:50.748054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.748054 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.760387 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1318/2611] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:50 2022] PUT /identity/v3/projects/5d765fb8a29d47588dd708a82feed705/users/1a3929c441774e1eaff37b865b7219d5/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:50.761136 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded57943-ed07-49a6-963b-32e1ae966c14 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.768148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.818853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.819731 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.820035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.820320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] PATH_INFO: `/v3/projects/bd8a2b20b5aa452ca3889913a7b18e27` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.821575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8a2b20b5aa452ca3889913a7b18e27)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.823618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.823862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19083d-c584-4c6a-9a6b-346a57c6d612 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.829039 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66b0aa-37e6-4936-ab8e-9ffcc2016c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.829692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b0aa-37e6-4936-ab8e-9ffcc2016c8c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.829977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b0aa-37e6-4936-ab8e-9ffcc2016c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.830255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b0aa-37e6-4936-ab8e-9ffcc2016c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.831682 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b0aa-37e6-4936-ab8e-9ffcc2016c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.833276 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b0aa-37e6-4936-ab8e-9ffcc2016c8c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:50.846880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1319/2612] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:50.846880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.846880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.846880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.864252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:50.865601 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:50.873301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1320/2613] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:50.874169 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:50.886301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eebd5-5e9d-4d4a-a328-a1fd7ec8c9b0 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:50.892178 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:50.893110 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:50.893393 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:50.893671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] PATH_INFO: `/v3/projects/599131369d8448d4b4ec2b650679be5e/users/3314e206ae3f40b0bfd9c6f4ff728dd8/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:50.909195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599131369d8448d4b4ec2b650679be5e, user_id=3314e206ae3f40b0bfd9c6f4ff728dd8, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:50.911907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:51.382720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1321/2614] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:50 2022] PUT /identity/v3/projects/599131369d8448d4b4ec2b650679be5e/users/3314e206ae3f40b0bfd9c6f4ff728dd8/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:51.382720 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:51.383856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8a2b20b5aa452ca3889913a7b18e27', 'request_id': 'req-0e6d9895-7769-470b-88a3-b446a3f2d602'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:51.393432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8a2b20b5aa452ca3889913a7b18e27', 'request_id': 'req-0e6d9895-7769-470b-88a3-b446a3f2d602'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:51.404711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:51.483929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384fba-5400-4a73-af83-ecce55619411 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:51.488111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285ae72-b60e-470c-8090-1de1e73c1ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:51.488760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285ae72-b60e-470c-8090-1de1e73c1ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:51.489046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285ae72-b60e-470c-8090-1de1e73c1ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:51.489326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285ae72-b60e-470c-8090-1de1e73c1ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:51.551864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285ae72-b60e-470c-8090-1de1e73c1ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:51.553228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285ae72-b60e-470c-8090-1de1e73c1ff1 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:51.562718 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1322/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:51.564103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:51.564396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:51.564803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:51.591433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] MFA Rules not processed for user `3314e206ae3f40b0bfd9c6f4ff728dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:51.593149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:51.658731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1323/2616] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:51.663349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:51.673832 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f988-b6d0-47b7-aec8-72f58b33432c None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:51.678388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:51.679078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:51.679361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:51.679636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:51.680341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:51.682310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:51.861450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8a2b20b5aa452ca3889913a7b18e27', 'request_id': 'req-0e6d9895-7769-470b-88a3-b446a3f2d602'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:51.876562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1324/2617] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:51 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:51.879542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] The token cache is being invalidate because project bd8a2b20b5aa452ca3889913a7b18e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:51.880493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:51.881408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:51.882420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:51.884899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1294/2618] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:50 2022] DELETE /identity/v3/projects/bd8a2b20b5aa452ca3889913a7b18e27 => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:51.894602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:51.895735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:51.975722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9895-7769-470b-88a3-b446a3f2d602 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:51.985907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:51.985907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:51.985907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:51.985907 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] PATH_INFO: `/v3/users/920ad3900202400185e7b7f900d16370` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:51.986306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e633-707d-4a4d-ac5f-0239a82ddbaf admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:51.988022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=920ad3900202400185e7b7f900d16370)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:51.989651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:51.990142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:51.990429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:51.990878 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:51.991082 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:51.991734 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:51.993631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.100482 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1325/2619] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:51 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:52.107537 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:52.110454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:52.133551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc14e-884f-458f-aacd-b2b52194a25b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:52.139318 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:52.140035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.140425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.140810 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.141672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:52.143561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.160469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1326/2620] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:52.161793 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:52.173576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029567e-21e0-43c8-9357-5977e295066f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:52.178837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:52.179722 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.180140 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.181056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.182003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:52.184228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.205528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1327/2621] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:52.206769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:52.210944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920ad3900202400185e7b7f900d16370'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:52.211629 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920ad3900202400185e7b7f900d16370'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:52.222400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920ad3900202400185e7b7f900d16370'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:52.223277 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b2824-72a4-444a-a664-05f6a06c7c4e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:52.232361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:52.232361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.232361 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.232818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] PATH_INFO: `/v3/projects/167f8a4697a74a3b92948e874ead8c0c/users/1968386478224cbebf78e5450ee339fe/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.249006 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167f8a4697a74a3b92948e874ead8c0c, user_id=1968386478224cbebf78e5450ee339fe, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:52.251817 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.311166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920ad3900202400185e7b7f900d16370'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:52.328974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-cc424482-f7d8-477c-9f2b-728ffc8fc4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920ad3900202400185e7b7f900d16370'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:52.334624 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1295/2622] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:51 2022] DELETE /identity/v3/users/920ad3900202400185e7b7f900d16370 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:52.353990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1328/2623] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:52 2022] PUT /identity/v3/projects/167f8a4697a74a3b92948e874ead8c0c/users/1968386478224cbebf78e5450ee339fe/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:52.364946 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.365247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.365536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.397683 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] MFA Rules not processed for user `1968386478224cbebf78e5450ee339fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:52.399103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:52.478264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1296/2624] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:52.482958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:52.485161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:52.591301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b179eb-ef07-4eb1-b989-d874a7fc1db7 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:52.597656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:52.599091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.599389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.599676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.600900 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:52.603348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.735170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1329/2625] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:52 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:52.736618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:52.747798 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045a54-4e8f-444d-a222-2f1cf03ad956 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:52.799043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:52.801701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:52.823593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:52.824817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.825320 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.825824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.827687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:52.839297 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.899826 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37ec9d-cc1b-40fb-80de-80b0299ab0ef admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:52.905412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:52.906498 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:52.906849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:52.907153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] PATH_INFO: `/v3/projects/fc8fe5aa05ab42dcabc7c17a74b13ccd` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:52.908354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8fe5aa05ab42dcabc7c17a74b13ccd)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:52.910375 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:52.981497 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1297/2626] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:52 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:52.985849 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.004347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28bb34-f8bc-42b2-b547-d0807ea353b7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.013787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.016198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.016590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.017124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.018552 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.021090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.028622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8fe5aa05ab42dcabc7c17a74b13ccd', 'request_id': 'req-0e88c554-f4f1-4e73-9e38-681d80a93f9a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:53.035488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8fe5aa05ab42dcabc7c17a74b13ccd', 'request_id': 'req-0e88c554-f4f1-4e73-9e38-681d80a93f9a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:53.040298 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1298/2627] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:53.041454 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.053349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32d69-493a-4d57-86b2-a36a88965457 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.101748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8fe5aa05ab42dcabc7c17a74b13ccd', 'request_id': 'req-0e88c554-f4f1-4e73-9e38-681d80a93f9a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:53.113495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] The token cache is being invalidate because project fc8fe5aa05ab42dcabc7c17a74b13ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:53.113788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:53.114539 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0e88c554-f4f1-4e73-9e38-681d80a93f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:53.114820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.115707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.115984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.116254 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] PATH_INFO: `/v3/projects/1f14c677e52446dfa6891abed596582a/users/8244210599304bd684ed545548590486/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.116390 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1330/2628] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:52 2022] DELETE /identity/v3/projects/fc8fe5aa05ab42dcabc7c17a74b13ccd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:53.120970 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47249ae-b664-418b-96cb-0028cef08176 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.121263 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47249ae-b664-418b-96cb-0028cef08176 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.121548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47249ae-b664-418b-96cb-0028cef08176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.140353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f14c677e52446dfa6891abed596582a, user_id=8244210599304bd684ed545548590486, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.143308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.146232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c47249ae-b664-418b-96cb-0028cef08176 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:53.147544 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c47249ae-b664-418b-96cb-0028cef08176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.162865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1331/2629] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:53.164519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.164885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.165180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.184123 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:53.185469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.194334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1332/2630] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:53.198483 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.208459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074dfb5-2a49-49da-a31d-6cb52a8c5f7e None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.213246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.214073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.214355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.219973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.219973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:02:53.219973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.219973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.230457 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1333/2631] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:02:53.236711 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.246990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c8688-dec0-48e3-b3f3-30ec12b089e7 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.251877 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.252534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.252825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.253122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.253809 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.255760 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.278537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1299/2632] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:53 2022] PUT /identity/v3/projects/1f14c677e52446dfa6891abed596582a/users/8244210599304bd684ed545548590486/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:53.280342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.283503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.352750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecff68-cf75-4474-b021-6b3ccb76250d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.360804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1334/2633] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:53.360987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b0be8-49b8-48d0-aee7-ba80a4309a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.362920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b0be8-49b8-48d0-aee7-ba80a4309a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.362920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b0be8-49b8-48d0-aee7-ba80a4309a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.363162 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.363288 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b0be8-49b8-48d0-aee7-ba80a4309a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.364030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b0be8-49b8-48d0-aee7-ba80a4309a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.365972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b0be8-49b8-48d0-aee7-ba80a4309a33 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.376958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1300/2634] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:02:53.378744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.378876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.379221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.409442 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] MFA Rules not processed for user `1a3929c441774e1eaff37b865b7219d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:53.410837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.435259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5629-5349-46e2-9bc2-6ffd0b282776 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.441115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c332f-9c86-45ef-82f1-08265d32541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.441973 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c332f-9c86-45ef-82f1-08265d32541a admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.442506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c332f-9c86-45ef-82f1-08265d32541a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.443616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c332f-9c86-45ef-82f1-08265d32541a admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.444622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c332f-9c86-45ef-82f1-08265d32541a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.447137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c332f-9c86-45ef-82f1-08265d32541a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.494873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1301/2635] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:53.495739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.507149 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb77286-49a2-4c10-88fd-676da89c0ee4 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.512155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.513093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.513382 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.516340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] PATH_INFO: `/v3/projects/1f14c677e52446dfa6891abed596582a/users/8244210599304bd684ed545548590486/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.516469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f14c677e52446dfa6891abed596582a, user_id=8244210599304bd684ed545548590486, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.519325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.530421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1302/2636] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:53 2022] PUT /identity/v3/projects/1f14c677e52446dfa6891abed596582a/users/8244210599304bd684ed545548590486/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:53.531496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.533071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.541432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1335/2637] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:02:53.542888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.543228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.543514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.571955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] MFA Rules not processed for user `8244210599304bd684ed545548590486`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:53.574340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.601354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085579-6e48-4003-aec4-ed62a19c8fc8 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.605631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.606202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.606482 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.606787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.643561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1336/2638] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:53.644630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.678444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.679935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.692067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1303/2639] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:53.692819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.694621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.707536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31522-a445-4278-a95a-e1b29872e9fb service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.712389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.713034 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.713317 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.713590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.714768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f235-faeb-4ebc-abeb-7a03420cf529 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.720813 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd5bb2-0c27-4cc6-9a52-930f4d51e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.721558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd5bb2-0c27-4cc6-9a52-930f4d51e60c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.721942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd5bb2-0c27-4cc6-9a52-930f4d51e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.722315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd5bb2-0c27-4cc6-9a52-930f4d51e60c admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.723211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd5bb2-0c27-4cc6-9a52-930f4d51e60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.723705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:53.724983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd5bb2-0c27-4cc6-9a52-930f4d51e60c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.727954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.729379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.736594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1337/2640] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:53.737950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.738376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.738770 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.743850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1304/2641] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:53.745026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.757548 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9d865-9be7-496c-bd00-cf7ad1f64742 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.760292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:53.761579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.762520 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.763343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.763612 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.763892 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.764654 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.766489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.795152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1305/2642] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:53.799504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.817414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:53.821973 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc4e09-8b4a-4807-9b53-9dcc888bfc54 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:53.829294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1338/2643] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:53.831645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ddc90-8fd8-4d56-83de-a1668d6ffc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:53.832364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ddc90-8fd8-4d56-83de-a1668d6ffc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.832647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ddc90-8fd8-4d56-83de-a1668d6ffc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.832975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ddc90-8fd8-4d56-83de-a1668d6ffc46 admin admin] PATH_INFO: `/v3/projects/5662c467fb9f4999a2b66ee7e1c6e6a5/users/5d7d122fbde342d5a2b39ae661d6e734/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.864767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ddc90-8fd8-4d56-83de-a1668d6ffc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5662c467fb9f4999a2b66ee7e1c6e6a5, user_id=5d7d122fbde342d5a2b39ae661d6e734, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:53.867472 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ddc90-8fd8-4d56-83de-a1668d6ffc46 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:53.878340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:53.884948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:53.966384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1306/2644] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:53 2022] PUT /identity/v3/projects/5662c467fb9f4999a2b66ee7e1c6e6a5/users/5d7d122fbde342d5a2b39ae661d6e734/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:53.976707 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:53.977202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:53.978211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:53.989522 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f4af5-fe0f-488f-9003-5fe6133d6984 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.011115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] MFA Rules not processed for user `5d7d122fbde342d5a2b39ae661d6e734`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:54.012400 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:54.054109 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.054789 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.055080 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.055363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.102645 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1307/2645] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:02:54.105176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:54.135165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.137271 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.147571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1339/2646] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 12:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:02:54.216751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b4122-d996-46b4-a7c2-bffc22b7663d None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.228895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.229947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.230301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.230679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.231386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.233325 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.322884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1308/2647] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:02:54 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:54.324961 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:54.336369 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8d5d3-f340-4be9-b55c-416dfbc1562c service swift] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.397871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.397871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.397871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.397871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.398656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.398656 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.531469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1340/2648] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:02:54 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:02:54.533720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:54.543887 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daaf52-d6a5-4491-8914-9c4b8241a186 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.548384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.549103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.549390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.549670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.550392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.552031 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.562965 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1309/2649] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:54.567237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:54.577911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f51703-f942-475a-9111-be533d3ee5b5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.582761 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.583679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.589133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.589133 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] PATH_INFO: `/v3/projects/97c1d905da2f4a35993386488dc49c3d/users/3e43788ea80a46438d8412d222498962/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.600003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c1d905da2f4a35993386488dc49c3d, user_id=3e43788ea80a46438d8412d222498962, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.603023 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.677258 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1341/2650] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:54 2022] PUT /identity/v3/projects/97c1d905da2f4a35993386488dc49c3d/users/3e43788ea80a46438d8412d222498962/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:02:54.682126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:54.692751 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5c8f-eb77-45fe-b55b-bbfa7e955c57 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.751076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f50f3-4961-41ab-b94a-725c05909ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.751816 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f50f3-4961-41ab-b94a-725c05909ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.752175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f50f3-4961-41ab-b94a-725c05909ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.752526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f50f3-4961-41ab-b94a-725c05909ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.753392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f50f3-4961-41ab-b94a-725c05909ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.755091 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f50f3-4961-41ab-b94a-725c05909ae6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.769008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1310/2651] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:02:54.774033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:54.781491 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8cea-167e-4c77-a7f1-c18f2b4552db admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:54.786802 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:54.788195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.788729 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.789176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] PATH_INFO: `/v3/projects/97c1d905da2f4a35993386488dc49c3d/users/3e43788ea80a46438d8412d222498962/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.791866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c1d905da2f4a35993386488dc49c3d, user_id=3e43788ea80a46438d8412d222498962, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:54.794561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:54.808700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1342/2652] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:02:54 2022] PUT /identity/v3/projects/97c1d905da2f4a35993386488dc49c3d/users/3e43788ea80a46438d8412d222498962/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:54.820215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:54.822869 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:54.824239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:54.851787 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] MFA Rules not processed for user `3e43788ea80a46438d8412d222498962`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:54.853073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:54.929785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1311/2653] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:54.942567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:55.006201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735abd-cf40-497c-905a-aa6ab31e8e21 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:55.010019 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f144a0-27db-4adf-89cc-c4d93c00323e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:55.010823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f144a0-27db-4adf-89cc-c4d93c00323e service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:55.011344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f144a0-27db-4adf-89cc-c4d93c00323e service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:55.011766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f144a0-27db-4adf-89cc-c4d93c00323e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:55.024764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f144a0-27db-4adf-89cc-c4d93c00323e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:55.026499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f144a0-27db-4adf-89cc-c4d93c00323e service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:55.041772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1343/2654] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:55.113048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:55.124107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86707-88d2-49e6-a434-4e759fefe4e3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:55.128082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:55.128727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:55.133595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:55.133595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:55.133595 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:55.219461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:55.220893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:55.230852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1312/2655] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:55.935239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:55.935588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:55.935952 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:55.954166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] MFA Rules not processed for user `1a3929c441774e1eaff37b865b7219d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:55.955410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:56.012687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1344/2656] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:56.328728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:56.518118 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:56.906163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:56.907727 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:56.965878 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0dc4-dcb1-4bbf-b605-f8ea055e5501 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:56.970331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:56.971020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:56.971308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:56.971588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:56.973425 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:57.040383 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:57.041956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e9d2-0ba7-45a2-a17c-651d92e3132d service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:57.058555 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1313/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:58.078568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:58.293212 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:58.364419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a54b-6f6c-4a03-8bb3-0f1166d00898 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:58.370216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:58.371090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:58.371372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:58.371659 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] PATH_INFO: `/v3/users/5d7d122fbde342d5a2b39ae661d6e734` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:58.372868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7d122fbde342d5a2b39ae661d6e734)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:58.374914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:58.524183 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:58.557001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7d122fbde342d5a2b39ae661d6e734'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:58.558740 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7d122fbde342d5a2b39ae661d6e734'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:58.626988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7d122fbde342d5a2b39ae661d6e734'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:58.634835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7d122fbde342d5a2b39ae661d6e734'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:58.646607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7d122fbde342d5a2b39ae661d6e734'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:58.652627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1345/2658] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:58 2022] DELETE /identity/v3/users/5d7d122fbde342d5a2b39ae661d6e734 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:58.657312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:58.657785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:58.658070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:58.677418 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:02:58.678761 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:58.738432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1314/2659] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:02:58.750860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:58.750860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:58.817990 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef942d8-2cce-481a-99b5-66951cdf1563 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:58.821838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:58.822479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:58.823116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:58.823116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:58.832330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:58.833758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:58.843521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1346/2660] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:59.138422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:02:59.287748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:59.290459 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:59.400338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb8e3-58ce-4b87-a1c2-5d6e32b0feb7 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:59.407475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:59.408135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:59.408420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:59.408701 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:59.410501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:59.429793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:59.431526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:59.443231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1315/2661] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:02:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:02:59.481665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:59.483614 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:02:59.506235 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333828-3053-4e71-8832-e1684d283a48 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:59.511775 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:59.512635 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:59.513094 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:59.513591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] PATH_INFO: `/v3/projects/5662c467fb9f4999a2b66ee7e1c6e6a5` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:59.515380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5662c467fb9f4999a2b66ee7e1c6e6a5)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:59.518214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:02:59.638536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5662c467fb9f4999a2b66ee7e1c6e6a5', 'request_id': 'req-94f25300-8122-494a-8512-585b0f04c7e4'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:59.644993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5662c467fb9f4999a2b66ee7e1c6e6a5', 'request_id': 'req-94f25300-8122-494a-8512-585b0f04c7e4'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:59.733974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5662c467fb9f4999a2b66ee7e1c6e6a5', 'request_id': 'req-94f25300-8122-494a-8512-585b0f04c7e4'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:59.747059 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] The token cache is being invalidate because project 5662c467fb9f4999a2b66ee7e1c6e6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:02:59.747415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:59.748107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:02:59.752914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1347/2662] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:02:59 2022] DELETE /identity/v3/projects/5662c467fb9f4999a2b66ee7e1c6e6a5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:02:59.754099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:02:59.765331 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32fac1-7c27-44bf-9646-8ab1ef4baded service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:02:59.833339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:02:59.834540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:02:59.835112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:02:59.835386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] PATH_INFO: `/v3/users/3e43788ea80a46438d8412d222498962` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:02:59.838273 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e43788ea80a46438d8412d222498962)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:02:59.840267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:00.095991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e43788ea80a46438d8412d222498962'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:00.097588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e43788ea80a46438d8412d222498962'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:00.105893 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e43788ea80a46438d8412d222498962'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:00.196882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:00.197733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e43788ea80a46438d8412d222498962'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:00.230850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e43788ea80a46438d8412d222498962'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:00.249151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1316/2663] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:02:59 2022] DELETE /identity/v3/users/3e43788ea80a46438d8412d222498962 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:00.301511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:00.422143 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:00.424461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:00.503754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25300-8122-494a-8512-585b0f04c7e4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:00.579191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:00.580081 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:00.580559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:00.580846 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:00.583405 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:00.651629 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:00.653319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8b55-2fb5-4589-8503-3ff8d614b6a6 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:00.663615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1348/2664] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:00.937371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:00.938889 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:01.015876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455113-cca2-48de-931c-3e7853ab6c88 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.021047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.022023 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.023658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.023658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] PATH_INFO: `/v3/projects/97c1d905da2f4a35993386488dc49c3d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.023850 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c1d905da2f4a35993386488dc49c3d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.025802 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.163876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c1d905da2f4a35993386488dc49c3d', 'request_id': 'req-fd0eee84-72b4-4e23-b079-b747790450f8'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:01.169378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c1d905da2f4a35993386488dc49c3d', 'request_id': 'req-fd0eee84-72b4-4e23-b079-b747790450f8'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:01.287239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c1d905da2f4a35993386488dc49c3d', 'request_id': 'req-fd0eee84-72b4-4e23-b079-b747790450f8'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:01.299835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] The token cache is being invalidate because project 97c1d905da2f4a35993386488dc49c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:01.300131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:01.300783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fd0eee84-72b4-4e23-b079-b747790450f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:01.302445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1317/2665] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:00 2022] DELETE /identity/v3/projects/97c1d905da2f4a35993386488dc49c3d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:01.307234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.307717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.307886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.327122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:01.328333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:01.387888 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1349/2666] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:01.397507 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.397799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.398081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.417540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:01.418779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:01.426741 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1318/2667] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:01.431287 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:01.441587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f20b9-673d-4e2f-bc1a-58a0893747f6 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.446222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.446983 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.447266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.447543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.448261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:01.448570 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.450160 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.463156 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1350/2668] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:01.467948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:01.477867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad548-95f1-41c0-8987-10e84998a4ad None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.496245 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.496917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.497205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.497474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.498167 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.500771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.596758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1319/2669] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:01 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:03:01.600171 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:01.615323 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fb06c-bcb3-4a66-a923-31ae000df555 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.650436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:01.691269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.692057 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.695234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.695234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.695234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.695546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.801480 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1351/2670] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:01 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:03:01.802613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:01.812789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c699-b5e3-4f71-a7a8-9f733dff6e57 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.817384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.818064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.818467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.818795 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.819664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.821401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.833255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1320/2671] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:01.837245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:01.849153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1779ae-2e38-42a1-b7c5-7851b6fc94e0 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.855297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54816b-a54e-4d84-89cc-154dd59407ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.856191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54816b-a54e-4d84-89cc-154dd59407ca admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.856477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54816b-a54e-4d84-89cc-154dd59407ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.856753 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54816b-a54e-4d84-89cc-154dd59407ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.857484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54816b-a54e-4d84-89cc-154dd59407ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.860029 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54816b-a54e-4d84-89cc-154dd59407ca admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.874161 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1352/2672] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:01.878691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:01.886204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965eccf-10d1-4af5-8cde-e91d4b3a9a62 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:01.891436 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:01.892309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:01.892585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:01.892853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] PATH_INFO: `/v3/projects/a497acf5e8de4ea998de1862f920ca30/users/ed96a94cedff40a3b4ba13849c0a21be/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:01.914653 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a497acf5e8de4ea998de1862f920ca30, user_id=ed96a94cedff40a3b4ba13849c0a21be, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:01.917316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:01.991025 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1321/2673] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:01 2022] PUT /identity/v3/projects/a497acf5e8de4ea998de1862f920ca30/users/ed96a94cedff40a3b4ba13849c0a21be/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:02.001236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.001532 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.001820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.028585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] MFA Rules not processed for user `ed96a94cedff40a3b4ba13849c0a21be`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:02.030349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:02.099748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1353/2674] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:02.106820 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:02.153314 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:02.176379 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbba09-f9bf-47dc-bb11-7de347789fbd admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:02.181760 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:02.182514 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.183039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.183486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.184373 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:02.187666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:02.304289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1322/2675] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:02 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:02.308391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:02.319432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7e4d-4c16-43ef-8c26-834d9eeac3d3 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:02.377543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:02.378205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.378484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.378788 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.379593 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:02.381453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:02.478381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:02.484261 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1354/2676] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:02 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:02.490249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:02.500384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d23e6f-830f-4124-9497-432ddd62c601 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:02.504996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:02.505697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.505961 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.506240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.507010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:02.508602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:02.520272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1323/2677] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:03:02.524266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:02.536299 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145dae-a1a9-4884-bf97-d9b4a6687ebb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:02.541231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd1d00-d31c-472a-8ee1-3d9eb205402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:02.541890 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1d00-d31c-472a-8ee1-3d9eb205402a admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.542177 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1d00-d31c-472a-8ee1-3d9eb205402a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.542460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1d00-d31c-472a-8ee1-3d9eb205402a admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.543220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd1d00-d31c-472a-8ee1-3d9eb205402a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:02.544874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd1d00-d31c-472a-8ee1-3d9eb205402a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:02.554974 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1355/2678] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:02.559099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:02.569650 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235f48-993a-4b81-9364-34dc5a7dc370 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:02.574923 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:02.575867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.576231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.577086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] PATH_INFO: `/v3/projects/92ab49fd97a54f7186aa52ab9362dc32/users/2475a866de9b40c69573d7a76d28837f/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.593066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ab49fd97a54f7186aa52ab9362dc32, user_id=2475a866de9b40c69573d7a76d28837f, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:02.595790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:02.708657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1324/2679] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:02 2022] PUT /identity/v3/projects/92ab49fd97a54f7186aa52ab9362dc32/users/2475a866de9b40c69573d7a76d28837f/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:02.719053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.719343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.719619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.750397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] MFA Rules not processed for user `2475a866de9b40c69573d7a76d28837f`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:02.751737 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:02.819147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1356/2680] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:02.824906 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:02.890938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb013ef-37e8-4f47-87ee-edd871fc83e6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:02.895690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:02.896350 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:02.896638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:02.896920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:02.897620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:02.899565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.005137 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1325/2681] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:02 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:03.009411 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.020222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a67d8-104e-48aa-9521-d9bb87365722 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.068398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.077568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.078266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.078553 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.078864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.079554 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.081508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.169843 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1357/2682] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:03 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:03.174570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.185093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f6ba-aaef-4ed7-b43c-a5dedb6602cc admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.192588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.193371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.193657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.193934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.194696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.196310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.208777 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1326/2683] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:03.213048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.223360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46b79-674e-451a-b9de-176aa0f52e93 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.228216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.229112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.229396 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.229667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] PATH_INFO: `/v3/projects/fd72b626c2fe42a89b14e6a0cc2b522f/users/b9b207447cab444c9a785e93f7e207fd/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.244670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd72b626c2fe42a89b14e6a0cc2b522f, user_id=b9b207447cab444c9a785e93f7e207fd, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.247342 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.267229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.350281 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1358/2684] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:03 2022] PUT /identity/v3/projects/fd72b626c2fe42a89b14e6a0cc2b522f/users/b9b207447cab444c9a785e93f7e207fd/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:03.354562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.364745 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c5a1-bbc5-40a2-96f1-67031e8417fc admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.419444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.419611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abfa6d-681c-4e8f-8459-08aa3cc2decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.420044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abfa6d-681c-4e8f-8459-08aa3cc2decd admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.420953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abfa6d-681c-4e8f-8459-08aa3cc2decd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.421229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abfa6d-681c-4e8f-8459-08aa3cc2decd admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.421959 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abfa6d-681c-4e8f-8459-08aa3cc2decd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.423580 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abfa6d-681c-4e8f-8459-08aa3cc2decd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.433211 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1327/2685] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:03.437249 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.447306 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1637-dcd5-4167-9925-81d4a5da119e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.451862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.452738 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] PATH_INFO: `/v3/projects/fd72b626c2fe42a89b14e6a0cc2b522f/users/b9b207447cab444c9a785e93f7e207fd/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.456382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd72b626c2fe42a89b14e6a0cc2b522f, user_id=b9b207447cab444c9a785e93f7e207fd, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.457885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.468343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1359/2686] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:03 2022] PUT /identity/v3/projects/fd72b626c2fe42a89b14e6a0cc2b522f/users/b9b207447cab444c9a785e93f7e207fd/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:03.479819 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.480376 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.480903 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.509078 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] MFA Rules not processed for user `b9b207447cab444c9a785e93f7e207fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:03.510192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:03.579258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1328/2687] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:03.586966 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.591273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.593657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:03.651694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4eac4-4d2b-40d8-a33e-6ed8f7c79d17 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.656002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.656642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.656929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.657210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.666278 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.667742 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.678357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1360/2688] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:03.764180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:03.773803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942eb30-4baf-4650-a3c2-7a0e4d6d0c1c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:03.777642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1756-6a08-41a3-87da-2dd0f34a4b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:03.778718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1756-6a08-41a3-87da-2dd0f34a4b9e service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:03.779013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1756-6a08-41a3-87da-2dd0f34a4b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:03.780152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1756-6a08-41a3-87da-2dd0f34a4b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:03.782413 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.832756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:03.838838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1756-6a08-41a3-87da-2dd0f34a4b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:03.840296 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1756-6a08-41a3-87da-2dd0f34a4b9e service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:03.850610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1329/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:04.129628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:04.299401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:04.798011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:04.799638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:04.863636 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186b659-5d8a-486f-acd5-55af1d18f3fd service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:04.868373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:04.869397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:04.869621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:04.869757 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] PATH_INFO: `/v3/users/3314e206ae3f40b0bfd9c6f4ff728dd8` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:04.870989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3314e206ae3f40b0bfd9c6f4ff728dd8)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:04.872966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:05.045079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:05.047670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3314e206ae3f40b0bfd9c6f4ff728dd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:05.048244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3314e206ae3f40b0bfd9c6f4ff728dd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:05.157300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3314e206ae3f40b0bfd9c6f4ff728dd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:05.165266 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3314e206ae3f40b0bfd9c6f4ff728dd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:05.178325 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3314e206ae3f40b0bfd9c6f4ff728dd8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:05.184644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1361/2690] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:04 2022] DELETE /identity/v3/users/3314e206ae3f40b0bfd9c6f4ff728dd8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:05.189880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:05.190327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:05.190437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:05.215426 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:05.216640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:05.282779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1330/2691] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:05.292941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:05.294355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:05.300037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:05.355591 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781c04-53d8-432c-87a6-67680b1f50b3 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:05.359495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:05.360135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:05.360420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:05.360698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:05.369755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:05.371228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:05.380920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1362/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:03:05.662607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:05.832340 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:05.833735 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:05.846008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8843f-1fb3-45ba-8bb3-a21dede577fe None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:05.853353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:05.854268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:05.854549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:05.854877 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] PATH_INFO: `/v3/projects/599131369d8448d4b4ec2b650679be5e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:05.856244 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=599131369d8448d4b4ec2b650679be5e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:05.858912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:05.963522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599131369d8448d4b4ec2b650679be5e', 'request_id': 'req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:05.969450 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599131369d8448d4b4ec2b650679be5e', 'request_id': 'req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.031016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:06.058533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599131369d8448d4b4ec2b650679be5e', 'request_id': 'req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.070773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] The token cache is being invalidate because project 599131369d8448d4b4ec2b650679be5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:06.071066 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.071705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.073263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1331/2693] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:05 2022] DELETE /identity/v3/projects/599131369d8448d4b4ec2b650679be5e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:06.077631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:06.087380 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bea8-7a0f-4182-8e2c-da3f796b666e service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:06.143830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:06.144714 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:06.145092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:06.145389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] PATH_INFO: `/v3/users/1968386478224cbebf78e5450ee339fe` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:06.146573 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1968386478224cbebf78e5450ee339fe)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:06.148543 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:06.359351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1968386478224cbebf78e5450ee339fe'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.360007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1968386478224cbebf78e5450ee339fe'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.436397 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1968386478224cbebf78e5450ee339fe'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.443937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1968386478224cbebf78e5450ee339fe'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.456478 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1968386478224cbebf78e5450ee339fe'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:06.458641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:06.462934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1363/2694] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:06 2022] DELETE /identity/v3/users/1968386478224cbebf78e5450ee339fe => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:07.072461 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:07.074009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:07.090628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1b20c-73b4-4e62-8c68-acbd64d83fce admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:07.112096 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:07.148872 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:07.149790 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:07.150073 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:07.150467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] PATH_INFO: `/v3/projects/167f8a4697a74a3b92948e874ead8c0c` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:07.151618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167f8a4697a74a3b92948e874ead8c0c)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:07.153553 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:07.307637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167f8a4697a74a3b92948e874ead8c0c', 'request_id': 'req-31262b9d-07a4-45d2-9a06-247f62a5e797'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.313197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167f8a4697a74a3b92948e874ead8c0c', 'request_id': 'req-31262b9d-07a4-45d2-9a06-247f62a5e797'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.453142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167f8a4697a74a3b92948e874ead8c0c', 'request_id': 'req-31262b9d-07a4-45d2-9a06-247f62a5e797'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.471271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] The token cache is being invalidate because project 167f8a4697a74a3b92948e874ead8c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:07.471888 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.473834 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.475689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1332/2695] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:07 2022] DELETE /identity/v3/projects/167f8a4697a74a3b92948e874ead8c0c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:07.480021 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:07.482221 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:07.496630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fd3f4-d573-4f09-a2bf-f73afedcde1c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:07.563068 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:07.563993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:07.564222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:07.564496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] PATH_INFO: `/v3/users/8244210599304bd684ed545548590486` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:07.565824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8244210599304bd684ed545548590486)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:07.567777 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:07.775725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8244210599304bd684ed545548590486'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.776384 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8244210599304bd684ed545548590486'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.843908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8244210599304bd684ed545548590486'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.851479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8244210599304bd684ed545548590486'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.865105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8244210599304bd684ed545548590486'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:07.871272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1364/2696] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:07 2022] DELETE /identity/v3/users/8244210599304bd684ed545548590486 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:08.006285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:08.007712 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.019970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262b9d-07a4-45d2-9a06-247f62a5e797 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:08.080565 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:08.081563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.082007 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.082389 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] PATH_INFO: `/v3/users/ed96a94cedff40a3b4ba13849c0a21be` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.083739 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed96a94cedff40a3b4ba13849c0a21be)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:08.085672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:08.291962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed96a94cedff40a3b4ba13849c0a21be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.292616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed96a94cedff40a3b4ba13849c0a21be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.300226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed96a94cedff40a3b4ba13849c0a21be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.313860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:08.315292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.329848 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2da42-a0ea-4473-b92f-ddd425f2b432 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:08.336924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:08.336924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.336924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.336924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] PATH_INFO: `/v3/projects/1f14c677e52446dfa6891abed596582a` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.337360 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f14c677e52446dfa6891abed596582a)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:08.339217 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:08.384471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed96a94cedff40a3b4ba13849c0a21be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.397107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-9bb50212-d269-43de-a993-bf26e4594f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed96a94cedff40a3b4ba13849c0a21be'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.402992 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1333/2697] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:08 2022] DELETE /identity/v3/users/ed96a94cedff40a3b4ba13849c0a21be => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:08.408042 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.408332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.408609 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.424756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:08.425940 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.459723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:08.469174 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f14c677e52446dfa6891abed596582a', 'request_id': 'req-e1cbc8ff-cd8c-4842-9280-1c8621a35272'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.474800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f14c677e52446dfa6891abed596582a', 'request_id': 'req-e1cbc8ff-cd8c-4842-9280-1c8621a35272'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.487021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1334/2698] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:08.496780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:08.498208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.527252 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f14c677e52446dfa6891abed596582a', 'request_id': 'req-e1cbc8ff-cd8c-4842-9280-1c8621a35272'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.542116 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] The token cache is being invalidate because project 1f14c677e52446dfa6891abed596582a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:08.542434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.543514 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e1cbc8ff-cd8c-4842-9280-1c8621a35272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:08.544696 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1365/2699] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:08 2022] DELETE /identity/v3/projects/1f14c677e52446dfa6891abed596582a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:08.552741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb0c80-b1bc-413d-9639-af4082a99252 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.553037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb0c80-b1bc-413d-9639-af4082a99252 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.553365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb0c80-b1bc-413d-9639-af4082a99252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.558710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c558-1795-475c-ae41-c3a456a00975 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:08.559891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:08.572468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f5cb0c80-b1bc-413d-9639-af4082a99252 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:08.573676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f5cb0c80-b1bc-413d-9639-af4082a99252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.613119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:08.613768 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.614049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.614324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.616168 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.640816 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1366/2700] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:08.649978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.650558 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.650868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.674631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:08.674631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:08.681873 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:08.684166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1367/2701] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:08.684842 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:08.690492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:08.695780 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1335/2702] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:03:08.699703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98876e05-7d6b-42b0-b1e7-609d4cea07ec None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:08.705330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:08.705978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.706260 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.706551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.707297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:08.707605 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:08.709245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:08.721047 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1368/2703] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:03:08.725463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:08.736203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d928b0-c68e-4284-9b09-265b8fa96fc4 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:08.741365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:08.742083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.742404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.742722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.743562 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:08.745623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:08.865708 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1336/2704] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:08 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:08.867637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:08.878297 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8ed7-fb51-4ea6-9ceb-ebf5a5d602a1 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:08.937830 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:08.938495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:08.938808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:08.939085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:08.939771 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:08.941772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.021977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1369/2705] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:08 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:09.026302 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.037109 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36193-aaba-4e1d-b62e-37375d6210de admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.041953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.043558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.043558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.043558 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.044129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.046147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.056676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1337/2706] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:09.060584 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.071255 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd016-e43a-4844-abe4-b93311921a0c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.075870 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.076549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.076827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.077105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.077825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.079443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.089199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1370/2707] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:09.093261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.103361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fee135-7f7b-4922-98f7-8481b39f3223 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.108628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff626ea3-b14c-4730-89b2-ee2887df44bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.109521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626ea3-b14c-4730-89b2-ee2887df44bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.109803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626ea3-b14c-4730-89b2-ee2887df44bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.110074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626ea3-b14c-4730-89b2-ee2887df44bb admin admin] PATH_INFO: `/v3/projects/33bbf1ee81024dd19a1a1c4cf73d1540/users/bff9d64494ae4dd598fa223d60464ca1/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.119408 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.121669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:09.129247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff626ea3-b14c-4730-89b2-ee2887df44bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bbf1ee81024dd19a1a1c4cf73d1540, user_id=bff9d64494ae4dd598fa223d60464ca1, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.132543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff626ea3-b14c-4730-89b2-ee2887df44bb admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.145948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515e09-3686-4c66-bf0e-752b5e7b0823 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.150739 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.151582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.151856 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.152134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] PATH_INFO: `/v3/projects/a497acf5e8de4ea998de1862f920ca30` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.153444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a497acf5e8de4ea998de1862f920ca30)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.158756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.216762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1338/2708] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:09 2022] PUT /identity/v3/projects/33bbf1ee81024dd19a1a1c4cf73d1540/users/bff9d64494ae4dd598fa223d60464ca1/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:09.228258 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.228753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.228896 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.255690 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] MFA Rules not processed for user `bff9d64494ae4dd598fa223d60464ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:09.257002 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:09.260190 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:09.277954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a497acf5e8de4ea998de1862f920ca30', 'request_id': 'req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.283349 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a497acf5e8de4ea998de1862f920ca30', 'request_id': 'req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.326817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1339/2709] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:09.331268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.333257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:09.355916 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a497acf5e8de4ea998de1862f920ca30', 'request_id': 'req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.369460 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] The token cache is being invalidate because project a497acf5e8de4ea998de1862f920ca30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:09.369651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.370337 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.371937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1371/2710] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:09 2022] DELETE /identity/v3/projects/a497acf5e8de4ea998de1862f920ca30 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:09.376431 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.377960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:09.398187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bed15-41b2-41db-a8ad-82716c1ebeaf None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.442415 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f90f-2e86-460a-b5e2-183f732ddcd2 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.447134 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.447993 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.448274 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.448549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] PATH_INFO: `/v3/users/2475a866de9b40c69573d7a76d28837f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.449741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2475a866de9b40c69573d7a76d28837f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.451774 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.453764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.454467 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.454785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.458543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.458543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.458543 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.573957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1340/2711] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:09 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:03:09.575077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.576767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:09.638998 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2cc0b-1ab1-48b1-8e7c-59dbff2d7481 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.644099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.644783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.645067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.645343 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.646052 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.648103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.651968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2475a866de9b40c69573d7a76d28837f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.659290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:09.659488 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2475a866de9b40c69573d7a76d28837f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.734853 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2475a866de9b40c69573d7a76d28837f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.741099 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1341/2712] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:09 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:03:09.743037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2475a866de9b40c69573d7a76d28837f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.744954 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.755985 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653dfc-2886-4193-8266-167ffea38115 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.757505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2475a866de9b40c69573d7a76d28837f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:09.760697 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.761489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.761782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.762061 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.762826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.764427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1372/2713] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:09 2022] DELETE /identity/v3/users/2475a866de9b40c69573d7a76d28837f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:09.772226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:09.777920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1342/2714] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:03:09.780231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:09.781924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:09.872248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1315f-7320-4466-9f27-7e99edfe1d3d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:09.877885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:09.889204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:09.889204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:09.889204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] PATH_INFO: `/v3/projects/2218160bc18f4b1799ac6d54a6c9db81/users/cddade1593694601a3fd332556e3a0d3/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:09.892799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:09.898248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2218160bc18f4b1799ac6d54a6c9db81, user_id=cddade1593694601a3fd332556e3a0d3, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:09.901329 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:10.010064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1373/2715] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:09 2022] PUT /identity/v3/projects/2218160bc18f4b1799ac6d54a6c9db81/users/cddade1593694601a3fd332556e3a0d3/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:10.014280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:10.026326 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b34032-9e17-4ebf-a319-7109db46c1bf admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:10.085246 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3945fd8-2ee0-453c-bb1f-bad21812cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:10.085908 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945fd8-2ee0-453c-bb1f-bad21812cf90 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:10.086312 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945fd8-2ee0-453c-bb1f-bad21812cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:10.086608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945fd8-2ee0-453c-bb1f-bad21812cf90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:10.087342 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3945fd8-2ee0-453c-bb1f-bad21812cf90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:10.089067 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3945fd8-2ee0-453c-bb1f-bad21812cf90 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:10.099353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1343/2716] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:03:10.103692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:10.114920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b5919-070c-4fb0-9992-0b2f49cb1d76 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:10.119584 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:10.120496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:10.120776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:10.121048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] PATH_INFO: `/v3/projects/2218160bc18f4b1799ac6d54a6c9db81/users/cddade1593694601a3fd332556e3a0d3/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:10.123037 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2218160bc18f4b1799ac6d54a6c9db81, user_id=cddade1593694601a3fd332556e3a0d3, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:10.126222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:10.136534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1374/2717] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:10 2022] PUT /identity/v3/projects/2218160bc18f4b1799ac6d54a6c9db81/users/cddade1593694601a3fd332556e3a0d3/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:10.148135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:10.148352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:10.148632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:10.176757 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] MFA Rules not processed for user `cddade1593694601a3fd332556e3a0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:10.177974 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:10.186315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:10.260732 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1344/2718] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:10.271966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:10.272319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:10.273779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:10.274128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:10.333793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27efa97-3bc5-464f-b11f-6c0d3f7ff57a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:10.337602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:10.338243 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:10.338526 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:10.338835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:10.340618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:10.346972 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eada5f-9f99-4a27-b04b-80278ac3f591 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:10.352230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:10.353173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:10.353524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:10.353894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] PATH_INFO: `/v3/projects/92ab49fd97a54f7186aa52ab9362dc32` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:10.355184 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ab49fd97a54f7186aa52ab9362dc32)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:10.359851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:10.400675 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:10.402020 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:10.411771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1345/2719] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:03:10.480962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ab49fd97a54f7186aa52ab9362dc32', 'request_id': 'req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.488609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ab49fd97a54f7186aa52ab9362dc32', 'request_id': 'req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.555818 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ab49fd97a54f7186aa52ab9362dc32', 'request_id': 'req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.569499 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] The token cache is being invalidate because project 92ab49fd97a54f7186aa52ab9362dc32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:10.569934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.570758 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.572658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1375/2720] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:10 2022] DELETE /identity/v3/projects/92ab49fd97a54f7186aa52ab9362dc32 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:10.576993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:10.588110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45479a-98fd-4d9e-a96e-8f72b3d7256e service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:10.647207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:10.648121 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:10.648411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:10.648691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] PATH_INFO: `/v3/users/b9b207447cab444c9a785e93f7e207fd` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:10.649928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b207447cab444c9a785e93f7e207fd)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:10.656345 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:10.853490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:10.877339 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b207447cab444c9a785e93f7e207fd'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.878095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b207447cab444c9a785e93f7e207fd'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.886945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b207447cab444c9a785e93f7e207fd'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.940826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b207447cab444c9a785e93f7e207fd'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.953315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3a5091ac-a787-43bf-9f94-2e928ce81569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b207447cab444c9a785e93f7e207fd'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:10.961266 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1346/2721] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:10 2022] DELETE /identity/v3/users/b9b207447cab444c9a785e93f7e207fd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:11.511584 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:11.514697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:11.526731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3cb2-1d88-48bb-b95a-cdc4a14b393c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:11.583374 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:11.584231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:11.584521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:11.584799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] PATH_INFO: `/v3/projects/fd72b626c2fe42a89b14e6a0cc2b522f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:11.585979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd72b626c2fe42a89b14e6a0cc2b522f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:11.587948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:11.594655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:11.729319 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd72b626c2fe42a89b14e6a0cc2b522f', 'request_id': 'req-b53682ad-49c8-4541-b042-1adc2b86f50a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:11.734713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd72b626c2fe42a89b14e6a0cc2b522f', 'request_id': 'req-b53682ad-49c8-4541-b042-1adc2b86f50a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:11.808998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd72b626c2fe42a89b14e6a0cc2b522f', 'request_id': 'req-b53682ad-49c8-4541-b042-1adc2b86f50a'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:11.820698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] The token cache is being invalidate because project fd72b626c2fe42a89b14e6a0cc2b522f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:11.820987 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:11.821616 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-b53682ad-49c8-4541-b042-1adc2b86f50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:11.823241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1376/2722] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:11 2022] DELETE /identity/v3/projects/fd72b626c2fe42a89b14e6a0cc2b522f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:11.829730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:11.830205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:11.830341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:11.847957 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:11.849200 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:11.908545 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1347/2723] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:11.917202 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:11.917496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:11.917781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:11.936315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:11.937542 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:11.945548 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1377/2724] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:11.949615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:11.959637 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b89-1f96-49bd-9ad9-28ec1273ebc3 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:11.964533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:11.965184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:11.965489 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:11.965764 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:11.966513 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:11.966862 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:11.968557 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:11.980661 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1348/2725] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:11.984831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:11.994115 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2807-9f06-44ce-a7ed-e4cc948a3920 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.000008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.000671 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.000956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.001229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.001923 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.003863 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.068186 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1378/2726] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:11 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:12.072262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:12.082217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c9795-0524-471f-aad1-eeb171f28bf2 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.138157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.138867 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.139146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.139424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.140115 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.142019 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.151818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:12.236826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1349/2727] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:12 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:12.239574 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:12.253031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbdb4-c679-45e3-bc02-5683083e34de admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.257945 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.258702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.258988 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.259293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.260060 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.261648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.272132 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1379/2728] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:03:12.276142 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:12.286043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5049f-a5bb-4a8b-8bd5-eef2d3c0037c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.290826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2b5d-7291-4d75-abf1-e18100c8c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.291479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2b5d-7291-4d75-abf1-e18100c8c07b admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.291767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2b5d-7291-4d75-abf1-e18100c8c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.292048 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2b5d-7291-4d75-abf1-e18100c8c07b admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.292773 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2b5d-7291-4d75-abf1-e18100c8c07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.294421 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2b5d-7291-4d75-abf1-e18100c8c07b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.305408 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1350/2729] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:12.309427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:12.319922 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b73e-c7a3-43b1-84bf-50903dbc44af admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.324518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.325376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.325660 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.325935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] PATH_INFO: `/v3/projects/4bb7294e1e6e4264b96f2b4b527934eb/users/f9f870150c104aa8a800ed22062c16ca/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.340398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb7294e1e6e4264b96f2b4b527934eb, user_id=f9f870150c104aa8a800ed22062c16ca, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.344130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.443776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1380/2730] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:12 2022] PUT /identity/v3/projects/4bb7294e1e6e4264b96f2b4b527934eb/users/f9f870150c104aa8a800ed22062c16ca/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:12.459728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.459728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.459728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.489005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] MFA Rules not processed for user `f9f870150c104aa8a800ed22062c16ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:12.490253 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:12.559308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1351/2731] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:12.571300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:12.573085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:12.633579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b27eef-7b85-4de9-a543-571b6dc465b3 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.637392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b0120-c942-4b03-997e-a69a762f5aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.638064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b0120-c942-4b03-997e-a69a762f5aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.638354 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b0120-c942-4b03-997e-a69a762f5aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.643095 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b0120-c942-4b03-997e-a69a762f5aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.647386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b0120-c942-4b03-997e-a69a762f5aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.648836 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b0120-c942-4b03-997e-a69a762f5aa9 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.658609 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1381/2732] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:12.677753 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:12.739522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbf570-f911-4ead-93a8-cb90b04d0f93 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:12.744140 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:12.745129 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:12.745371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:12.745648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] PATH_INFO: `/v3/users/f9f870150c104aa8a800ed22062c16ca` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:12.746874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f870150c104aa8a800ed22062c16ca)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:12.748803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:12.965765 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f870150c104aa8a800ed22062c16ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:12.966447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f870150c104aa8a800ed22062c16ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:12.974230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f870150c104aa8a800ed22062c16ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.053119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f870150c104aa8a800ed22062c16ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.064282 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:13.066272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f870150c104aa8a800ed22062c16ca'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.073495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1352/2733] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:12 2022] DELETE /identity/v3/users/f9f870150c104aa8a800ed22062c16ca => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:13.083938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:13.084250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:13.084604 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:13.102823 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:13.104450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:13.134073 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:13.164975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1382/2734] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:13.174693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:13.176147 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:13.235156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbb85b-380b-405e-b7cf-38cd3c9c00d2 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:13.238933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:13.239608 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:13.239962 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:13.240240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:13.250510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:13.252088 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:13.262117 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1353/2735] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:13.536454 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:13.537918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:13.550382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fcc41-2bff-4b45-9719-71bfa3e9991d None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:13.557979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:13.557979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:13.557979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:13.557979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] PATH_INFO: `/v3/users/bff9d64494ae4dd598fa223d60464ca1` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:13.560412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff9d64494ae4dd598fa223d60464ca1)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:13.563069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:13.781698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:13.783276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:13.791861 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff9d64494ae4dd598fa223d60464ca1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.792585 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff9d64494ae4dd598fa223d60464ca1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.799217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df136d1-15eb-49fe-a564-2eeb3d761d79 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:13.804059 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:13.806693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:13.806693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:13.806693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] PATH_INFO: `/v3/projects/4bb7294e1e6e4264b96f2b4b527934eb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:13.806693 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb7294e1e6e4264b96f2b4b527934eb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:13.808663 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:13.866407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff9d64494ae4dd598fa223d60464ca1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.880675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff9d64494ae4dd598fa223d60464ca1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.886779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-6e504363-6766-4eb5-b7ec-33ef7b302a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff9d64494ae4dd598fa223d60464ca1'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.892806 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1383/2736] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:13 2022] DELETE /identity/v3/users/bff9d64494ae4dd598fa223d60464ca1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:13.897121 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:13.897419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:13.897690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:13.913620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb7294e1e6e4264b96f2b4b527934eb', 'request_id': 'req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.919546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:13.919546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:13.919758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb7294e1e6e4264b96f2b4b527934eb', 'request_id': 'req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:13.975398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1384/2737] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:13.985653 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:13.987188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.001470 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb7294e1e6e4264b96f2b4b527934eb', 'request_id': 'req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:14.013086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] The token cache is being invalidate because project 4bb7294e1e6e4264b96f2b4b527934eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:14.013377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:14.014087 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-835c88bc-bb01-4482-aeb1-2653c1b9c4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:14.015901 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1354/2738] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:13 2022] DELETE /identity/v3/projects/4bb7294e1e6e4264b96f2b4b527934eb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:14.021510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f419-7f11-4e9a-98bd-f3dc91505771 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.021822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f419-7f11-4e9a-98bd-f3dc91505771 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.022084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f419-7f11-4e9a-98bd-f3dc91505771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.040593 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7615f419-7f11-4e9a-98bd-f3dc91505771 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:14.044259 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:14.044404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7615f419-7f11-4e9a-98bd-f3dc91505771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.048509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66225d6f-fcb0-4621-97c6-d5d46c3b8485 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.051576 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1355/2739] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:14.052512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.053159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.053446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.053724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.059074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.059640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.063037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.063037 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.072578 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.074027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.079587 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:14.080859 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.084849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1385/2740] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:03:14.089261 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1356/2741] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:14.094317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.104001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ea9d2-a492-48ad-9075-d7e4a00ae79b service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.109400 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.110093 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.110685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.110969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.111701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:14.112011 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.113627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.125303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1386/2742] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:14.129604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.139556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b04d-5025-48c7-b7bb-69a1c500d329 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.144187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.144917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.145203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.145476 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.146166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.148071 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.283378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1357/2743] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:14 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:14.287453 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.297841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a299b-5d08-4a64-b02d-0d892e330159 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.380989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.382208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.382566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.382947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.383781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.386147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.479827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1387/2744] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:14 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:14.481021 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.491840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019400e-31ff-4d3b-ae39-b2a0c2d4fdc3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.496879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.509045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.509045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.509045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.509045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.509045 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.513101 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1358/2745] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:14.517839 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.528519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1101a-4523-42c6-aa88-0a0d516715c9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.533991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f17414-5539-4db3-bce7-a0017553e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.534743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f17414-5539-4db3-bce7-a0017553e35d admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.535027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f17414-5539-4db3-bce7-a0017553e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.535310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f17414-5539-4db3-bce7-a0017553e35d admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.536074 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f17414-5539-4db3-bce7-a0017553e35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.537695 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f17414-5539-4db3-bce7-a0017553e35d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.551873 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1388/2746] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:03:14.553201 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.563717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed849d76-ee6b-4de5-ab5a-df10d322d0d5 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.568542 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7380f-73a6-4d40-8e08-5af25520c744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.569437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7380f-73a6-4d40-8e08-5af25520c744 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.569722 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7380f-73a6-4d40-8e08-5af25520c744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.569999 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7380f-73a6-4d40-8e08-5af25520c744 admin admin] PATH_INFO: `/v3/projects/8998be48b21047de95a8a857be4f2962/users/490dd49e41a44b4c91a903eb45fd4c42/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.586276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7380f-73a6-4d40-8e08-5af25520c744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8998be48b21047de95a8a857be4f2962, user_id=490dd49e41a44b4c91a903eb45fd4c42, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.589124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7380f-73a6-4d40-8e08-5af25520c744 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.667024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1359/2747] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:14 2022] PUT /identity/v3/projects/8998be48b21047de95a8a857be4f2962/users/490dd49e41a44b4c91a903eb45fd4c42/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:14.676865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.677243 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.677594 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.705511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] MFA Rules not processed for user `490dd49e41a44b4c91a903eb45fd4c42`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:14.707000 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.766617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.766924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.767206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.779376 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1389/2748] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:14.783921 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] MFA Rules not processed for user `1a3929c441774e1eaff37b865b7219d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:14.785170 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.790192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:14.793301 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.794744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.841222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:14.843968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1360/2749] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:14.847782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:14.849074 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:14.857331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32903f-0445-4215-8b17-b5f86d26d4a2 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.865630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14349e981de34943823081c4470cea88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.866291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.866679 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.866909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.877576 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.882703 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:14.893956 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1390/2750] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:03:14.942015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb1fa3-f4f9-4eb8-a488-07a2d3d3f766 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:14.947540 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:14.948401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:14.948684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:14.948956 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] PATH_INFO: `/v3/projects/33bbf1ee81024dd19a1a1c4cf73d1540` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:14.950134 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bbf1ee81024dd19a1a1c4cf73d1540)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:14.952804 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:15.093846 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bbf1ee81024dd19a1a1c4cf73d1540', 'request_id': 'req-8684548b-f23e-41b0-8069-3197b0cbd5ff'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.103632 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bbf1ee81024dd19a1a1c4cf73d1540', 'request_id': 'req-8684548b-f23e-41b0-8069-3197b0cbd5ff'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.238009 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bbf1ee81024dd19a1a1c4cf73d1540', 'request_id': 'req-8684548b-f23e-41b0-8069-3197b0cbd5ff'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.255865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] The token cache is being invalidate because project 33bbf1ee81024dd19a1a1c4cf73d1540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:15.256154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.256940 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.258549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1361/2751] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:14 2022] DELETE /identity/v3/projects/33bbf1ee81024dd19a1a1c4cf73d1540 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:15.263005 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:15.274130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a704-7840-4197-bfc4-5c29852eb31f service glance] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:15.330882 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:15.332517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:15.332880 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:15.333234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] PATH_INFO: `/v3/users/cddade1593694601a3fd332556e3a0d3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:15.334518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddade1593694601a3fd332556e3a0d3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:15.336568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:15.567008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddade1593694601a3fd332556e3a0d3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.570072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddade1593694601a3fd332556e3a0d3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.643332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddade1593694601a3fd332556e3a0d3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.651333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddade1593694601a3fd332556e3a0d3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.671579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03788956-7723-4709-b59f-16e126890ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddade1593694601a3fd332556e3a0d3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:15.678038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1391/2752] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:15 2022] DELETE /identity/v3/users/cddade1593694601a3fd332556e3a0d3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:16.135230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.136828 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:16.157623 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684548b-f23e-41b0-8069-3197b0cbd5ff admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.202172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:16.218615 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.219670 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.220077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.220369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] PATH_INFO: `/v3/projects/2218160bc18f4b1799ac6d54a6c9db81` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.221740 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2218160bc18f4b1799ac6d54a6c9db81)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.223673 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:16.324669 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2218160bc18f4b1799ac6d54a6c9db81', 'request_id': 'req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:16.331184 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2218160bc18f4b1799ac6d54a6c9db81', 'request_id': 'req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:16.391952 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2218160bc18f4b1799ac6d54a6c9db81', 'request_id': 'req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:16.404451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] The token cache is being invalidate because project 2218160bc18f4b1799ac6d54a6c9db81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:16.404752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:16.405428 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-fa4d3c04-dd6a-422f-bc91-43b8d2a4b996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:16.407018 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1362/2753] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:16 2022] DELETE /identity/v3/projects/2218160bc18f4b1799ac6d54a6c9db81 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:16.412084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.412583 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.412685 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.431546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:16.432783 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:16.502053 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1392/2754] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:16.510347 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.510681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.510967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.530662 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:16.531880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:16.540175 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1363/2755] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:16.544501 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.555333 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768808e-e9f5-4e26-b014-4c7609045898 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.563199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.563875 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.564159 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.564438 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.565241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:16.565551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.567434 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:16.569234 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:16.580676 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1393/2756] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:16.585106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.594358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519bfc-5739-43f4-818c-d9cca71461e9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.599177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.599818 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.600106 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.600386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.601236 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.603496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:16.735394 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1364/2757] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:16 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:16.739879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.751367 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905324fb-c657-41d0-b30e-4639679d3bc4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.811552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.812246 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.812559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.812803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.813495 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.815452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:16.884389 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1394/2758] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:16 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:03:16.888390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.898915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5657dc-8c0d-4777-aad5-91a5e254dc24 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.903570 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.904225 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.905044 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.905323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.906068 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.907691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:16.918008 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1365/2759] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:16.922674 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.933187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cc472-a7cc-48f3-be47-4556723d4c68 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.937908 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a387fe6-ee9f-4b09-893c-b3cd211b1fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.938571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a387fe6-ee9f-4b09-893c-b3cd211b1fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.938886 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a387fe6-ee9f-4b09-893c-b3cd211b1fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.939228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a387fe6-ee9f-4b09-893c-b3cd211b1fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.939957 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a387fe6-ee9f-4b09-893c-b3cd211b1fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.941557 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a387fe6-ee9f-4b09-893c-b3cd211b1fc8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:16.952090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1395/2760] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:16.956446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:16.966679 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85941604-21a6-4085-9965-7e57fc09eb2d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:16.972081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:16.972968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:16.973305 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:16.973714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] PATH_INFO: `/v3/projects/91df77be7c454aa787270f7db7561956/users/97ebc371cc084e8d8dc3666e902847e6/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:16.992138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df77be7c454aa787270f7db7561956, user_id=97ebc371cc084e8d8dc3666e902847e6, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:16.994812 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:17.084456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1366/2761] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:16 2022] PUT /identity/v3/projects/91df77be7c454aa787270f7db7561956/users/97ebc371cc084e8d8dc3666e902847e6/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:17.095401 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:17.095749 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:17.096038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:17.123630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] MFA Rules not processed for user `97ebc371cc084e8d8dc3666e902847e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:17.124827 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:17.193200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1396/2762] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:17.204248 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:17.206036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:17.269127 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850acd17-a96a-4576-a76f-d7cb96ce12e6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:17.272895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b998ff-5c4e-4732-be38-a30caf441b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:17.273561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b998ff-5c4e-4732-be38-a30caf441b8c service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:17.273843 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b998ff-5c4e-4732-be38-a30caf441b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:17.274153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b998ff-5c4e-4732-be38-a30caf441b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:17.288145 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b998ff-5c4e-4732-be38-a30caf441b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:17.289584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b998ff-5c4e-4732-be38-a30caf441b8c service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:17.299414 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1367/2763] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:17.323519 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:17.396425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf9d7-2843-4a46-be07-1d374862ac57 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:17.400951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:17.405804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:17.405804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:17.405804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] PATH_INFO: `/v3/users/97ebc371cc084e8d8dc3666e902847e6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:17.405804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ebc371cc084e8d8dc3666e902847e6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:17.406153 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:17.408508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:17.657469 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ebc371cc084e8d8dc3666e902847e6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:17.658953 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ebc371cc084e8d8dc3666e902847e6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:17.746549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ebc371cc084e8d8dc3666e902847e6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:17.755588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ebc371cc084e8d8dc3666e902847e6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:17.772308 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ebc371cc084e8d8dc3666e902847e6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:17.782419 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1397/2764] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:17 2022] DELETE /identity/v3/users/97ebc371cc084e8d8dc3666e902847e6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:17.786264 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:17.786642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:17.786931 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:17.808746 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:17.809996 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:17.819135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:17.873050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1368/2765] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:17.883459 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:17.884889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:17.958854 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6407-463a-46ef-8006-a8d32d79f465 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:17.962399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000e2d6-9f83-489d-9b32-d0ef7969b15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:17.963794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000e2d6-9f83-489d-9b32-d0ef7969b15a service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:17.963794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000e2d6-9f83-489d-9b32-d0ef7969b15a service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:17.963794 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000e2d6-9f83-489d-9b32-d0ef7969b15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:17.974022 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000e2d6-9f83-489d-9b32-d0ef7969b15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:17.975556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000e2d6-9f83-489d-9b32-d0ef7969b15a service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:17.992947 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1398/2766] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:18.547267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:18.548884 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:18.561378 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea46e5-0e00-492a-95d2-d1dc706ab902 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:18.566035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:18.566936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:18.567221 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:18.567505 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] PATH_INFO: `/v3/projects/91df77be7c454aa787270f7db7561956` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:18.568702 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] RBAC: Authorizing `identity:delete_project(project_id=91df77be7c454aa787270f7db7561956)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:18.571213 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:18.703579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91df77be7c454aa787270f7db7561956', 'request_id': 'req-e8f9397b-b901-4168-954d-29aefa98806e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:18.709916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91df77be7c454aa787270f7db7561956', 'request_id': 'req-e8f9397b-b901-4168-954d-29aefa98806e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:18.781574 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91df77be7c454aa787270f7db7561956', 'request_id': 'req-e8f9397b-b901-4168-954d-29aefa98806e'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:18.793744 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] The token cache is being invalidate because project 91df77be7c454aa787270f7db7561956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:18.794110 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:18.794830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:18.797090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1369/2767] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:18 2022] DELETE /identity/v3/projects/91df77be7c454aa787270f7db7561956 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:27.982245 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:28.790738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:37.789036 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:37.789566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:37.789566 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:37.808295 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:37.809520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:37.879899 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1399/2768] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jun 16 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:37.893076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:37.896301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:37.985319 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9397b-b901-4168-954d-29aefa98806e admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:37.991131 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:37.991758 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:37.992041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:37.992314 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:38.000929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:38.004919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:38.010630 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1370/2769] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 12:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:03:39.071965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:39.074669 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:39.151190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb060-22b3-4937-b06d-29898eb98370 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:39.154791 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:39.155463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:39.156048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:39.156048 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:39.158699 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:39.234078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:39.235567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5384875-2ec3-4248-83fd-55e7e315c2d8 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:39.246895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1400/2770] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:39.293152 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:39.294738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:39.321060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabf16-e464-4ada-a34a-47dce0146d02 service swift] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:39.333386 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:39.335057 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:39.335709 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:39.336445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] PATH_INFO: `/v3/users/490dd49e41a44b4c91a903eb45fd4c42` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:39.338532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490dd49e41a44b4c91a903eb45fd4c42)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:39.341381 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:39.569622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490dd49e41a44b4c91a903eb45fd4c42'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:39.570622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490dd49e41a44b4c91a903eb45fd4c42'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:39.587912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490dd49e41a44b4c91a903eb45fd4c42'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:39.665915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490dd49e41a44b4c91a903eb45fd4c42'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:39.683958 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490dd49e41a44b4c91a903eb45fd4c42'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:39.692681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1371/2771] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:39 2022] DELETE /identity/v3/users/490dd49e41a44b4c91a903eb45fd4c42 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:39.697224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:39.697520 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:39.697803 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:39.725248 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:39.727670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:39.802232 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:39.818785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1401/2772] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:39.831005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:39.834156 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:39.931215 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21848b6e-96a5-4f3f-9f71-e2591dbbaac3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:39.948882 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d443b6-7903-41fd-a709-0b2a97a229eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:39.949640 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d443b6-7903-41fd-a709-0b2a97a229eb service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:39.949935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d443b6-7903-41fd-a709-0b2a97a229eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:39.950222 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d443b6-7903-41fd-a709-0b2a97a229eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:39.972891 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d443b6-7903-41fd-a709-0b2a97a229eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:39.974346 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d443b6-7903-41fd-a709-0b2a97a229eb service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:39.986086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1372/2773] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:40.515446 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:40.516960 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:40.533915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5bf38-41cd-4da6-b899-3dd0afc71995 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:40.544335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:40.545741 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:40.546641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:40.547137 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] PATH_INFO: `/v3/projects/8998be48b21047de95a8a857be4f2962` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:40.549441 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8998be48b21047de95a8a857be4f2962)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:40.551820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:40.740895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8998be48b21047de95a8a857be4f2962', 'request_id': 'req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:40.749648 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8998be48b21047de95a8a857be4f2962', 'request_id': 'req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:40.826279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8998be48b21047de95a8a857be4f2962', 'request_id': 'req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:40.842117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] The token cache is being invalidate because project 8998be48b21047de95a8a857be4f2962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:40.843031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:40.843296 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-62f7ddb3-3d4e-41d1-b09e-3e2a076ac3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:40.848929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1402/2774] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:40 2022] DELETE /identity/v3/projects/8998be48b21047de95a8a857be4f2962 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:40.851112 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:40.851616 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:40.851728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:40.874492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:40.893658 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:40.894980 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:40.979874 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1373/2775] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:40.990330 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:40.990652 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:40.990939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.028874 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:41.030132 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:41.039917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1403/2776] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:41.046633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:41.057604 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ad3bf-b4aa-46ce-9b81-f5739a1be782 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:41.063503 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:41.064518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.065026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.065527 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.066481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:41.067041 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:41.069060 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:41.086016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1374/2777] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:41.090251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:41.101052 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f171d4-e7db-4072-aff6-fb3fa83410ac None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:41.106563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:41.107264 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.107555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.107840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.108689 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:41.111208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:41.304378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1404/2778] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:41 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:41.307100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:41.325093 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dadea-bda8-4a3b-b298-c3af73e06dd6 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:41.432354 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:41.434228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.434228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.435085 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.436490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:41.440177 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:41.609803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1375/2779] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:41 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:41.614128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:41.636211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee38c-88f7-4049-bab2-6ccf6be07094 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:41.644950 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:41.645917 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.646410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.647555 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.650658 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:41.654199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:41.678272 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1405/2780] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:41.681927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:41.695943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce1e8-a2c9-49ea-a673-50d03e881c9d admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:41.701160 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae878b-7803-47c2-8f27-60afab7ad6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:41.702483 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae878b-7803-47c2-8f27-60afab7ad6cd admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.702920 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae878b-7803-47c2-8f27-60afab7ad6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.703208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae878b-7803-47c2-8f27-60afab7ad6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.703943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae878b-7803-47c2-8f27-60afab7ad6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:41.706199 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae878b-7803-47c2-8f27-60afab7ad6cd admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:41.724207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1376/2781] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:41.728534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:41.745638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6f438-5c11-4b4f-b456-cba19219b0ff admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:41.751841 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:41.753463 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.753885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.754176 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] PATH_INFO: `/v3/projects/51410a1748f44d24ae66abf772e16b5d/users/1ffce04f12dc4d3e8c9f5bf0990ab4ef/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.784959 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51410a1748f44d24ae66abf772e16b5d, user_id=1ffce04f12dc4d3e8c9f5bf0990ab4ef, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:41.798200 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:41.890630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1406/2782] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:41 2022] PUT /identity/v3/projects/51410a1748f44d24ae66abf772e16b5d/users/1ffce04f12dc4d3e8c9f5bf0990ab4ef/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:41.894762 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca1a75-48b0-45d0-8730-f9f2abc6ee7b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:41.895840 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca1a75-48b0-45d0-8730-f9f2abc6ee7b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:41.896291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca1a75-48b0-45d0-8730-f9f2abc6ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:41.916217 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-28ca1a75-48b0-45d0-8730-f9f2abc6ee7b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:41.917547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-28ca1a75-48b0-45d0-8730-f9f2abc6ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:41.999585 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1377/2783] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:42.006033 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:42.007975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:42.093112 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29b8f-a479-48e1-8a30-26102064561d admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:42.099067 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:42.100136 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:42.100440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:42.100715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:42.118206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:42.120304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:42.133216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1407/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:03:43.721734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:43.722704 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:43.723143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:43.747588 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:43.761748 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] MFA Rules not processed for user `1ffce04f12dc4d3e8c9f5bf0990ab4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:43.763308 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:43.889644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1378/2785] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:43.909603 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:43.913493 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:43.951521 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:43.988641 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:43.991405 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:44.015717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3e75-6840-4212-a712-ea5f3b4cae6a None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:44.023803 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:44.025035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:44.025639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:44.026404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] PATH_INFO: `/v3/users/3cf5430244c340f6988b3a9ebca9d777` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:44.027915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf5430244c340f6988b3a9ebca9d777)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:44.031250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:44.037450 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8e9f-b49e-4ca4-9079-457100485563 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:44.044027 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:44.044698 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:44.045035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:44.045315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:44.063610 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:44.065069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:44.087086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1408/2786] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:44.293827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf5430244c340f6988b3a9ebca9d777'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:44.294837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf5430244c340f6988b3a9ebca9d777'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:44.302176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf5430244c340f6988b3a9ebca9d777'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:44.367456 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf5430244c340f6988b3a9ebca9d777'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:44.383747 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-211e5f2b-4d97-45a0-b813-d4301a497f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf5430244c340f6988b3a9ebca9d777'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:44.390276 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1379/2787] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:43 2022] DELETE /identity/v3/users/3cf5430244c340f6988b3a9ebca9d777 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:44.706971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:44.719709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb226d-0ecb-4dd1-b8da-77cf0078c4c8 service cinder] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:44.827536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:44.827536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:44.827536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:44.827536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] PATH_INFO: `/v3/projects/ac92d33d0472472e8f02874fb93f21b7` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:44.827971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac92d33d0472472e8f02874fb93f21b7)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:44.827971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.108642 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac92d33d0472472e8f02874fb93f21b7', 'request_id': 'req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:45.116064 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac92d33d0472472e8f02874fb93f21b7', 'request_id': 'req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:45.202985 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac92d33d0472472e8f02874fb93f21b7', 'request_id': 'req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:45.227663 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] The token cache is being invalidate because project ac92d33d0472472e8f02874fb93f21b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:45.228113 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:45.243941 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-0b7c80f8-b4e2-4475-8d08-7cf9ba2d5d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:45.248348 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1409/2788] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:44 2022] DELETE /identity/v3/projects/ac92d33d0472472e8f02874fb93f21b7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:45.254120 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.255401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.255838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.279592 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:45.284561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:45.366631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1380/2789] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:45.372241 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.372538 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.372932 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.392085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:45.393432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:45.406138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1410/2790] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:45.411716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:45.422040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5790ace-4a4d-40c9-9f29-a4b31d0dd921 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:45.438501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:45.439239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.439523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.439821 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.440567 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:45.440871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:45.442480 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.453439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:45.459392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1381/2791] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:45.462336 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:45.472421 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412a838-17c7-490d-822a-1b2cef4e708d None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:45.477534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:45.478213 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.478654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.478937 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.479639 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:45.481638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.562939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1411/2792] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:45 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:45.565094 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:45.577122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d59b1-e751-4413-afdf-d19f595584d7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:45.651915 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:45.653268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.653947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.654336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.655275 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:45.657911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.771837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1382/2793] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:45 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:45.776207 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:45.789158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79175-c61b-4406-9bf5-a87c46dccbe7 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:45.794084 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:45.794906 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.795196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.795531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.796265 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:45.797913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.812966 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1412/2794] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:45.814138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:45.831202 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e0c8f-18d9-4cd0-95a6-3c7522109fd0 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:45.836263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8a07-9c57-4f58-a279-8078399960ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:45.837047 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8a07-9c57-4f58-a279-8078399960ee admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.837458 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8a07-9c57-4f58-a279-8078399960ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.837814 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8a07-9c57-4f58-a279-8078399960ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.838759 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8a07-9c57-4f58-a279-8078399960ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:45.840631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8a07-9c57-4f58-a279-8078399960ee admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.853004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1383/2795] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:45.858130 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:45.869867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924349e-b59b-4c42-8975-9438cfeed85c admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:45.874898 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:45.875949 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.876461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.876750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] PATH_INFO: `/v3/projects/ca3ac0a9d82b4001999aa508aa0a54f2/users/3d143d12f7a04408a5742d292635a0cd/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:45.895914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:45.903747 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3ac0a9d82b4001999aa508aa0a54f2, user_id=3d143d12f7a04408a5742d292635a0cd, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:45.906381 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:45.990172 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1413/2796] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:45 2022] PUT /identity/v3/projects/ca3ac0a9d82b4001999aa508aa0a54f2/users/3d143d12f7a04408a5742d292635a0cd/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:45.991681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f058e4-3f94-4bb7-9864-82237574cca9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:45.992206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f058e4-3f94-4bb7-9864-82237574cca9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:45.992518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f058e4-3f94-4bb7-9864-82237574cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:46.021827 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-c3f058e4-3f94-4bb7-9864-82237574cca9 None None] MFA Rules not processed for user `3d143d12f7a04408a5742d292635a0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:46.023138 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-c3f058e4-3f94-4bb7-9864-82237574cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:46.104696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1384/2797] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:46.117220 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:46.120546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:46.221986 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc67c-3dd8-4b1b-9060-bdf5db6ab28f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:46.229884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:46.230746 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:46.242796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:46.242796 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:46.248929 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9517eac-74fb-4279-9a98-23e7b880e495 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:46.249447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9517eac-74fb-4279-9a98-23e7b880e495 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:46.249796 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9517eac-74fb-4279-9a98-23e7b880e495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:46.258458 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:46.260122 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:46.271463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a9517eac-74fb-4279-9a98-23e7b880e495 None None] MFA Rules not processed for user `1ffce04f12dc4d3e8c9f5bf0990ab4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:46.272107 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1414/2798] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:46.281610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a9517eac-74fb-4279-9a98-23e7b880e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:46.364311 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1385/2799] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:46.566251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:46.681717 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8b793-ac67-4d6e-8f10-4be51d9f57f0 service nova] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:46.688108 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:46.689269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:46.689627 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:46.690516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] PATH_INFO: `/v3/users/3d143d12f7a04408a5742d292635a0cd` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:46.698852 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d143d12f7a04408a5742d292635a0cd)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:46.701485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:46.904504 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d143d12f7a04408a5742d292635a0cd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:46.905440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d143d12f7a04408a5742d292635a0cd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:46.980002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d143d12f7a04408a5742d292635a0cd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:46.993335 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d143d12f7a04408a5742d292635a0cd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:47.011768 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:47.017582 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d143d12f7a04408a5742d292635a0cd'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:47.030623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1415/2800] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:46 2022] DELETE /identity/v3/users/3d143d12f7a04408a5742d292635a0cd => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:47.033865 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:47.034157 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:47.034568 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:47.060638 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:47.062401 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:47.074469 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:47.147755 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1386/2801] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:47.159196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:47.160046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:47.256867 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a6e-4993-479a-8fad-722747e86d94 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:47.260571 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a21142-19a2-468c-9c4d-36dc4ccf22ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:47.261222 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21142-19a2-468c-9c4d-36dc4ccf22ee service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:47.261503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21142-19a2-468c-9c4d-36dc4ccf22ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:47.261782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21142-19a2-468c-9c4d-36dc4ccf22ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:47.282129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a21142-19a2-468c-9c4d-36dc4ccf22ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:47.285909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a21142-19a2-468c-9c4d-36dc4ccf22ee service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:47.297951 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1416/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:47.826026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:47.826026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:47.839687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cab17-404e-441d-a8d5-9548a2441d36 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:47.846192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:47.859687 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:47.860280 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:47.861203 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] PATH_INFO: `/v3/projects/ca3ac0a9d82b4001999aa508aa0a54f2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:47.864535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3ac0a9d82b4001999aa508aa0a54f2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:47.867446 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:48.019972 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3ac0a9d82b4001999aa508aa0a54f2', 'request_id': 'req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:48.030691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3ac0a9d82b4001999aa508aa0a54f2', 'request_id': 'req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:48.500619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3ac0a9d82b4001999aa508aa0a54f2', 'request_id': 'req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:48.513750 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] The token cache is being invalidate because project ca3ac0a9d82b4001999aa508aa0a54f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:48.514155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:48.514825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-d135fc6c-34a7-4d71-ae93-3af6aaf985a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:48.516384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1387/2803] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:47 2022] DELETE /identity/v3/projects/ca3ac0a9d82b4001999aa508aa0a54f2 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:48.522315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:48.522840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:48.522939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:48.543724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:48.545001 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:48.615114 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1417/2804] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:48.622880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:48.623151 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:48.623441 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:48.647205 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:48.650648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:48.663718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1388/2805] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:48.668157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:48.680556 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7116908-4a0f-423f-8108-274abf932ae8 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:48.685725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:48.692840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:48.693688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:48.693965 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:48.694887 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:48.695341 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:48.697496 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:48.714618 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1418/2806] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:48.716696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:48.730141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24ab9c-f448-4a10-bf31-a0687a51b73c None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:48.735336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:48.736095 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:48.736471 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:48.736832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:48.737611 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:48.739676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:48.840397 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1389/2807] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:48 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:48.844622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:48.864838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa45059-7b81-4494-b4fb-9ed0cc68c6d3 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:48.953484 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:48.955821 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:48.956343 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:48.956948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:48.957980 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:48.960420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:49.030756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1419/2808] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:48 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:49.035600 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:49.050427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57977-c355-4360-81a5-1d667d226949 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:49.056166 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:49.059240 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:49.059728 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:49.060293 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:49.061214 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:49.063349 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:49.077227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1390/2809] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:49.085422 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:49.098688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395fc8-66d6-4fcc-934d-6347e9f5793b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:49.104913 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661c28-596d-4cd1-8051-0039c51c1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:49.105979 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661c28-596d-4cd1-8051-0039c51c1e14 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:49.106365 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661c28-596d-4cd1-8051-0039c51c1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:49.106724 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661c28-596d-4cd1-8051-0039c51c1e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:49.107633 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67661c28-596d-4cd1-8051-0039c51c1e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:49.109351 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67661c28-596d-4cd1-8051-0039c51c1e14 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:49.118007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:49.126440 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1420/2810] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:49.131049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:49.144338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad088de0-3dcc-4fc7-af2c-17a8584b3f9c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:49.149734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:49.150681 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:49.150975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:49.151257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] PATH_INFO: `/v3/projects/a1a9b713ff0f4a82ba83bfcc759706d3/users/c323904674d541288c92bfd318018ad1/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:49.175927 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a9b713ff0f4a82ba83bfcc759706d3, user_id=c323904674d541288c92bfd318018ad1, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:49.179594 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:49.364496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1391/2811] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:49 2022] PUT /identity/v3/projects/a1a9b713ff0f4a82ba83bfcc759706d3/users/c323904674d541288c92bfd318018ad1/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:49.375984 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:49.376363 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:49.376579 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:49.413776 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] MFA Rules not processed for user `c323904674d541288c92bfd318018ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:49.416975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:49.517602 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1421/2812] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:49.523239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:49.569064 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:49.604672 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2b6d-dc58-4093-89ae-3925e398e7c3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:49.610026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:49.610940 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:49.611291 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:49.612206 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:49.614284 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:49.616371 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:49.726647 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1392/2813] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:49 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:49.728439 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:49.741667 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fe5cc-e1a1-4781-aee0-fa0e191a439d None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:49.835549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:49.836414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:49.836772 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:49.837223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:49.838085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:49.840309 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:49.991929 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1422/2814] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:49 2022] POST /identity/v3/users => generated 306 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:49.992993 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:50.004212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dd585-415b-4f6f-a952-435dadaa1df7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:50.010628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:50.011495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:50.011941 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:50.012419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:50.013327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:50.015153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:50.034544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1393/2815] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:50.039372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:50.051228 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f340-02de-4a63-be44-3302d6d70c2b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:50.056315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:50.057205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:50.057486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:50.057766 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] PATH_INFO: `/v3/projects/a317382f09c744c99fd0efaca49708c1/users/88ec5653a6984408bbbab6f9d4f76cc2/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:50.076414 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a317382f09c744c99fd0efaca49708c1, user_id=88ec5653a6984408bbbab6f9d4f76cc2, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:50.079128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:50.175510 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1423/2816] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:50 2022] PUT /identity/v3/projects/a317382f09c744c99fd0efaca49708c1/users/88ec5653a6984408bbbab6f9d4f76cc2/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:50.180257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:50.198502 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589825cb-31dc-4c60-a55d-5eb0cd011482 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:50.322737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592abd9f-4bb1-48bf-bb36-250acc875e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:50.323586 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592abd9f-4bb1-48bf-bb36-250acc875e9f admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:50.323994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592abd9f-4bb1-48bf-bb36-250acc875e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:50.324396 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592abd9f-4bb1-48bf-bb36-250acc875e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:50.327500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592abd9f-4bb1-48bf-bb36-250acc875e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:50.330639 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592abd9f-4bb1-48bf-bb36-250acc875e9f admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:50.348863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1394/2817] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:50.356144 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:50.374963 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2854-64c8-449d-a6f9-3abf9d914a12 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:50.403466 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:50.404386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:50.404672 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:50.404955 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] PATH_INFO: `/v3/projects/a317382f09c744c99fd0efaca49708c1/users/88ec5653a6984408bbbab6f9d4f76cc2/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:50.410239 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a317382f09c744c99fd0efaca49708c1, user_id=88ec5653a6984408bbbab6f9d4f76cc2, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:50.415971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:50.461436 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1424/2818] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:50 2022] PUT /identity/v3/projects/a317382f09c744c99fd0efaca49708c1/users/88ec5653a6984408bbbab6f9d4f76cc2/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:50.463551 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:50.464024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:50.464449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:50.511517 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] MFA Rules not processed for user `88ec5653a6984408bbbab6f9d4f76cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:50.512163 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:50.633866 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1395/2819] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:50.651492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:50.653316 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:50.725189 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:50.747981 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a47537-0c27-4a19-9976-de3e55506f20 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:50.754568 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830d60-9791-479c-9317-36c9d6fe7f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:50.757135 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830d60-9791-479c-9317-36c9d6fe7f90 service cinder] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:50.757643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830d60-9791-479c-9317-36c9d6fe7f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:50.758151 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830d60-9791-479c-9317-36c9d6fe7f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:50.776429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d830d60-9791-479c-9317-36c9d6fe7f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:50.778223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d830d60-9791-479c-9317-36c9d6fe7f90 service cinder] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:50.796104 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1425/2820] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:51.082420 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:51.093444 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b153-6afd-4b7f-bb71-14d16173ef66 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:51.097835 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:51.098475 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:51.098793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:51.099072 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:51.130549 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:51.164660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:51.166338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:51.177494 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1396/2821] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:56.561257 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:56.561731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:56.561831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:56.579764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] MFA Rules not processed for user `25a7024445c04ac4bcd168b2e8a5365b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:56.581524 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:56.621490 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:56.638662 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1426/2822] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jun 16 12:03:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:56.651407 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:56.652820 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:56.692338 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcbcfd-db3e-435c-96c2-fd335f588f36 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:56.699982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:56.700881 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:56.701165 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:56.702948 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] PATH_INFO: `/v3/users/c323904674d541288c92bfd318018ad1` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:56.704767 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c323904674d541288c92bfd318018ad1)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:56.707622 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:56.729971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bd44e-c6df-4acf-9d6d-49b505106515 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:56.735461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9d6d0-1d24-4234-ad9b-97efb7e409a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfd6158f5124d7cb71c8a77485ff6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:56.740715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d6d0-1d24-4234-ad9b-97efb7e409a6 service swift] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:56.740715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d6d0-1d24-4234-ad9b-97efb7e409a6 service swift] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:56.740715 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d6d0-1d24-4234-ad9b-97efb7e409a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:56.744814 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9d6d0-1d24-4234-ad9b-97efb7e409a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:56.746399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9d6d0-1d24-4234-ad9b-97efb7e409a6 service swift] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:56.755190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1427/2823] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jun 16 12:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:03:56.937692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c323904674d541288c92bfd318018ad1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:56.938336 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c323904674d541288c92bfd318018ad1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:56.946141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c323904674d541288c92bfd318018ad1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.031621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c323904674d541288c92bfd318018ad1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.046128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c323904674d541288c92bfd318018ad1'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.052692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1397/2824] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:56 2022] DELETE /identity/v3/users/c323904674d541288c92bfd318018ad1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:03:57.057331 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:57.057623 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:57.064044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:57.076508 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:57.077745 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:57.135798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1428/2825] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:57.145838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:57.147521 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:57.202392 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:57.207642 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723aff-0b6e-4f2f-a90e-f1763386510a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:57.211324 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:57.211968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:57.212255 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:57.212536 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:57.221423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:57.222967 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:57.233036 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1398/2826] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:03:57.713645 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:57.715654 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:57.729291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf277c17-f8c1-4fbe-9f7b-785772c63fe5 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:57.734067 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:57.734968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:57.735251 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:57.735527 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] PATH_INFO: `/v3/projects/a1a9b713ff0f4a82ba83bfcc759706d3` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:57.736700 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a9b713ff0f4a82ba83bfcc759706d3)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:57.738798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:57.758911 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:57.853366 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a9b713ff0f4a82ba83bfcc759706d3', 'request_id': 'req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.858977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a9b713ff0f4a82ba83bfcc759706d3', 'request_id': 'req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.934385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a9b713ff0f4a82ba83bfcc759706d3', 'request_id': 'req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.956214 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] The token cache is being invalidate because project a1a9b713ff0f4a82ba83bfcc759706d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:57.956736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.957693 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:57.959534 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1429/2827] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:57 2022] DELETE /identity/v3/projects/a1a9b713ff0f4a82ba83bfcc759706d3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:57.963437 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:57.974038 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8ee6-87bd-438d-ada8-9d0b67fb2feb service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:58.035348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:58.036235 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:58.036515 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:58.036788 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] PATH_INFO: `/v3/users/88ec5653a6984408bbbab6f9d4f76cc2` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:58.037995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ec5653a6984408bbbab6f9d4f76cc2)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:58.039937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:58.254970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ec5653a6984408bbbab6f9d4f76cc2'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:58.255586 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ec5653a6984408bbbab6f9d4f76cc2'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:58.262895 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ec5653a6984408bbbab6f9d4f76cc2'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:58.350969 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ec5653a6984408bbbab6f9d4f76cc2'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:58.363789 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-70112989-b22f-49fa-8084-f18a7daebeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ec5653a6984408bbbab6f9d4f76cc2'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:58.369776 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1399/2828] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:57 2022] DELETE /identity/v3/users/88ec5653a6984408bbbab6f9d4f76cc2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:58.832587 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:58.834087 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:58.848194 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0d1e-32b9-4aef-8d0e-b7005f1510b5 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:58.910690 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:58.911567 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:58.911851 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:58.912129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] PATH_INFO: `/v3/projects/a317382f09c744c99fd0efaca49708c1` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:58.913378 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a317382f09c744c99fd0efaca49708c1)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:58.915425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.019785 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a317382f09c744c99fd0efaca49708c1', 'request_id': 'req-c6aad298-8efb-4891-bfb2-68ba2917d8e0'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:59.025666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a317382f09c744c99fd0efaca49708c1', 'request_id': 'req-c6aad298-8efb-4891-bfb2-68ba2917d8e0'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:59.093800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a317382f09c744c99fd0efaca49708c1', 'request_id': 'req-c6aad298-8efb-4891-bfb2-68ba2917d8e0'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:59.106158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] The token cache is being invalidate because project a317382f09c744c99fd0efaca49708c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:03:59.106531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:59.107619 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-c6aad298-8efb-4891-bfb2-68ba2917d8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:03:59.108998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1430/2829] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:03:58 2022] DELETE /identity/v3/projects/a317382f09c744c99fd0efaca49708c1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:59.116141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.116141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.116659 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.139841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:59.141113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:59.221968 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1400/2830] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:03:59.225580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.225896 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.226179 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.248779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:59.250014 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:59.258638 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1431/2831] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:59.263141 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.274143 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46bc22-cfb1-405a-81d5-128c1c0fc19f None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.279938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.281268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.281633 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.281995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] PATH_INFO: `/v3/domains` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.283875 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91906) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:03:59.284265 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.285938 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.289173 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:59.298692 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1401/2832] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:03:59.306506 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.316481 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e8591-123c-4231-b67f-3508fdf07d25 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.321199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.321918 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.322269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.322625 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.323518 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.325562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.416347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1432/2833] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:59 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:59.420321 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.430182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea974f14-c8e3-4c17-8736-ac32eda64316 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.487660 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.488323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.488636 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.488913 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.489711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.491667 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.606620 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1402/2834] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:03:59 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:03:59.608141 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.615157 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:03:59.619373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5530a-41e2-4cb0-b504-aa0ad964b7e4 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.624083 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.624992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.625358 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.625709 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.626444 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.628647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.647528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1433/2835] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:59.651537 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.662130 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e778-005c-43a1-9ad0-7de674518aa7 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.669547 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece1b8c-74b5-46f2-ada4-12522562aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.670239 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1b8c-74b5-46f2-ada4-12522562aaee admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.670523 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1b8c-74b5-46f2-ada4-12522562aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.670899 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1b8c-74b5-46f2-ada4-12522562aaee admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.676300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece1b8c-74b5-46f2-ada4-12522562aaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.676300 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece1b8c-74b5-46f2-ada4-12522562aaee admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.683738 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1403/2836] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:03:59.688452 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.701697 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee218bc-6ce0-4ee4-8cb8-c93f1f2d091e admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.706099 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.707009 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] REQUEST_METHOD: `PUT` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.707290 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.707561 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] PATH_INFO: `/v3/projects/0ef61db9f30e4d5c9f6d1edf6d2a1f71/users/55b4883721bc44eb9e40e415d8e3fcc6/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.723909 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef61db9f30e4d5c9f6d1edf6d2a1f71, user_id=55b4883721bc44eb9e40e415d8e3fcc6, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.727219 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.803035 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1434/2837] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:03:59 2022] PUT /identity/v3/projects/0ef61db9f30e4d5c9f6d1edf6d2a1f71/users/55b4883721bc44eb9e40e415d8e3fcc6/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:03:59.814179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.815050 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.815328 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.843355 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] MFA Rules not processed for user `55b4883721bc44eb9e40e415d8e3fcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:03:59.844579 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:59.905326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.905326 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:03:59.910323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1404/2838] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:03:59.915353 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:03:59.972497 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1e9b5-9960-425f-bad4-67632102b53b admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.977670 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.978531 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.978847 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.978984 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f612c-e4a0-4b93-94c1-1b4fc816ff1b None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:03:59.979127 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] PATH_INFO: `/v3/users/1a3929c441774e1eaff37b865b7219d5` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.980315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3929c441774e1eaff37b865b7219d5)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.982237 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.983696 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:03:59.984268 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:03:59.984561 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:03:59.984833 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:03:59.985516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:03:59.987453 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:03:59.995685 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:00.093132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1405/2839] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:03:59 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:04:00.097619 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.159069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b206-2608-49a8-8890-931c14f542d3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.163573 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.164228 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.164554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.164826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] PATH_INFO: `/v3/users` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.165618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.167554 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.202486 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3929c441774e1eaff37b865b7219d5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.203158 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3929c441774e1eaff37b865b7219d5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.264033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1406/2840] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:04:00 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:04:00.268289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.278077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282022-c9e3-4914-a432-8ba909bf2b92 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.280755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3929c441774e1eaff37b865b7219d5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.284153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.284811 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.285154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.285432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.286155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.287825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.289195 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3929c441774e1eaff37b865b7219d5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.299077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1407/2841] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:04:00.303090 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.304546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3929c441774e1eaff37b865b7219d5'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.311382 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1435/2842] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:03:59 2022] DELETE /identity/v3/users/1a3929c441774e1eaff37b865b7219d5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:00.319119 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f17c2-043d-42c0-9435-64c9f998b60a admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.380807 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.381700 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.381982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.382283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] PATH_INFO: `/v3/projects/f8b3bc8fb69f444e941642d5ba4a6479/users/dd3b8fb1e0b54199b224ddfd10a6252b/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.397783 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3bc8fb69f444e941642d5ba4a6479, user_id=dd3b8fb1e0b54199b224ddfd10a6252b, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.400535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.495384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1408/2843] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:04:00 2022] PUT /identity/v3/projects/f8b3bc8fb69f444e941642d5ba4a6479/users/dd3b8fb1e0b54199b224ddfd10a6252b/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:00.500185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.501725 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:00.522620 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d79e-bd2b-4132-8143-9e7ea2399e07 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.573034 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:00.589286 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.590078 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.590432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.590924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.597939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.597939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.604516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1436/2844] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:04:00.608752 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.619377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8d6e-0de6-498d-968b-89546fa28186 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.624262 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0ae8-abd3-4425-8db8-934d5ef784bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.625301 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0ae8-abd3-4425-8db8-934d5ef784bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.625581 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0ae8-abd3-4425-8db8-934d5ef784bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.625863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0ae8-abd3-4425-8db8-934d5ef784bc admin admin] PATH_INFO: `/v3/projects/f8b3bc8fb69f444e941642d5ba4a6479/users/dd3b8fb1e0b54199b224ddfd10a6252b/roles/e19ffe8952bd42cab77eea1f65717c00` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.629463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0ae8-abd3-4425-8db8-934d5ef784bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3bc8fb69f444e941642d5ba4a6479, user_id=dd3b8fb1e0b54199b224ddfd10a6252b, role_id=e19ffe8952bd42cab77eea1f65717c00)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.630391 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.632399 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:00.635656 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0ae8-abd3-4425-8db8-934d5ef784bc admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.647468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d52bb-9ff1-4495-a19b-b94405830a08 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.653928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1409/2845] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:04:00 2022] PUT /identity/v3/projects/f8b3bc8fb69f444e941642d5ba4a6479/users/dd3b8fb1e0b54199b224ddfd10a6252b/roles/e19ffe8952bd42cab77eea1f65717c00 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:04:00.670720 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.671424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.671837 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.703076 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] MFA Rules not processed for user `dd3b8fb1e0b54199b224ddfd10a6252b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:00.704292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:00.713513 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.714622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.715069 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.715347 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] PATH_INFO: `/v3/projects/5d765fb8a29d47588dd708a82feed705` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.716608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d765fb8a29d47588dd708a82feed705)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.719666 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.731911 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:00.777975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1410/2846] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:04:00.788522 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:00.789905 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:00.847079 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef68bc-1618-46c6-8600-61f2aa57d9f8 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:00.850680 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:00.851419 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:00.851698 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:00.851971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:00.854030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:00.875430 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d765fb8a29d47588dd708a82feed705', 'request_id': 'req-bf28e61b-e3b1-47e5-a84b-a61797421826'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.887170 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d765fb8a29d47588dd708a82feed705', 'request_id': 'req-bf28e61b-e3b1-47e5-a84b-a61797421826'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.917894 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:00.919294 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:00.928599 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1411/2847] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:04:00.985128 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d765fb8a29d47588dd708a82feed705', 'request_id': 'req-bf28e61b-e3b1-47e5-a84b-a61797421826'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.999617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] The token cache is being invalidate because project 5d765fb8a29d47588dd708a82feed705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:04:00.999617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:00.999617 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:01.001192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1437/2848] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:04:00 2022] DELETE /identity/v3/projects/5d765fb8a29d47588dd708a82feed705 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:06.064880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:06.066327 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:06.077799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f075a-0449-4098-9e4a-5468aeecb834 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:06.129285 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:06.129703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:06.130026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:06.130257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:06.132671 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:06.163435 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=100 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:06.195189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:06.196617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a402b-e19f-4bda-b663-7cc58410b990 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:06.206153 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1412/2849] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:11.077204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:11.947242 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:11.949694 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:12.015476 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28e61b-e3b1-47e5-a84b-a61797421826 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:12.020432 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:12.021126 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:12.021412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:12.021687 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] PATH_INFO: `/v3/users/55b4883721bc44eb9e40e415d8e3fcc6` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:12.022938 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b4883721bc44eb9e40e415d8e3fcc6)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:12.025191 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:12.234244 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b4883721bc44eb9e40e415d8e3fcc6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:12.234905 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b4883721bc44eb9e40e415d8e3fcc6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:12.294090 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b4883721bc44eb9e40e415d8e3fcc6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:12.305420 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b4883721bc44eb9e40e415d8e3fcc6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:12.317866 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b4883721bc44eb9e40e415d8e3fcc6'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:12.324344 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1438/2850] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:04:11 2022] DELETE /identity/v3/users/55b4883721bc44eb9e40e415d8e3fcc6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:12.329043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:12.329564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:12.329682 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:12.346714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:12.347897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:12.407485 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1413/2851] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:12.417668 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:12.419208 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:12.475138 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a0350-a3c7-4cdf-b820-e4272897dee9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:12.479644 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:12.480279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:12.480562 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:12.480838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:12.494142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:12.494142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:12.501879 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1439/2852] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:12.910691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:12.913926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:12.930806 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdfdf6-b448-4a6f-bea3-8782a7cbebf9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:12.933432 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:12.934352 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:12.934742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:12.935084 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] PATH_INFO: `/v3/projects/0ef61db9f30e4d5c9f6d1edf6d2a1f71` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:12.936249 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef61db9f30e4d5c9f6d1edf6d2a1f71)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:12.938289 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:13.055135 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef61db9f30e4d5c9f6d1edf6d2a1f71', 'request_id': 'req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.060566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef61db9f30e4d5c9f6d1edf6d2a1f71', 'request_id': 'req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.128159 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef61db9f30e4d5c9f6d1edf6d2a1f71', 'request_id': 'req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.139705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] The token cache is being invalidate because project 0ef61db9f30e4d5c9f6d1edf6d2a1f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:04:13.139994 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.140628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.142229 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1414/2853] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:04:12 2022] DELETE /identity/v3/projects/0ef61db9f30e4d5c9f6d1edf6d2a1f71 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:13.146148 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:13.155884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ab0e-20dd-4e15-b2e8-e62ecadb14a7 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:13.174334 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:13.213517 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:13.214385 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:13.214702 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:13.214978 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] PATH_INFO: `/v3/users/dd3b8fb1e0b54199b224ddfd10a6252b` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:13.216163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3b8fb1e0b54199b224ddfd10a6252b)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:13.218070 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:13.432536 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3b8fb1e0b54199b224ddfd10a6252b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.433167 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3b8fb1e0b54199b224ddfd10a6252b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.504691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3b8fb1e0b54199b224ddfd10a6252b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.511726 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3b8fb1e0b54199b224ddfd10a6252b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.523969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-d020d563-4ca6-4817-acbe-c1cecbc05ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3b8fb1e0b54199b224ddfd10a6252b'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:13.529962 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1440/2854] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:04:13 2022] DELETE /identity/v3/users/dd3b8fb1e0b54199b224ddfd10a6252b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:13.924029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:13.925463 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:13.942063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52981b-b57e-45b3-a6eb-b333e0b11f2b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:13.993451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:14.000912 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.006628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.006628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.006628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] PATH_INFO: `/v3/projects/f8b3bc8fb69f444e941642d5ba4a6479` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.006628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b3bc8fb69f444e941642d5ba4a6479)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.006628 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.156924 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b3bc8fb69f444e941642d5ba4a6479', 'request_id': 'req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:14.162192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b3bc8fb69f444e941642d5ba4a6479', 'request_id': 'req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:14.265824 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b3bc8fb69f444e941642d5ba4a6479', 'request_id': 'req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:14.277856 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] The token cache is being invalidate because project f8b3bc8fb69f444e941642d5ba4a6479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:04:14.278146 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:14.278799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-f1477395-8cd1-4ab0-bf5d-df7ca1dbe86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:14.280323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1415/2855] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:04:13 2022] DELETE /identity/v3/projects/f8b3bc8fb69f444e941642d5ba4a6479 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:14.286307 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.286754 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.287038 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.304569 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:14.305763 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:14.363443 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1441/2856] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:04:14.374879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.375192 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.375500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.393987 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:14.395233 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:14.403030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1416/2857] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:14.407165 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:14.417229 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17ecf-02f3-498a-9153-26c7ed350b33 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:14.421780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.422425 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.422756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.423044 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.423773 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:04:14.424086 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.425704 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.437968 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1442/2858] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:04:14.442118 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:14.451853 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cbc3-6a42-4c71-8af2-03a9390e6ebe None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:14.456544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.457212 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.457500 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.457781 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.458474 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.461013 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.523785 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1417/2859] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:04:14 2022] POST /identity/v3/projects => generated 359 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:04:14.527779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:14.537621 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd2a7-e2a6-48e8-9a8c-2c2f08783abd admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:14.562798 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:14.592862 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.593516 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.593800 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.594077 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.594795 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.596683 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.693831 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1443/2860] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:04:14 2022] POST /identity/v3/users => generated 280 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:04:14.698649 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:14.709081 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aafd73-3c6f-4ec5-8f06-8d7a14f66053 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:14.714779 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.715447 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.715734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.717648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.717648 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.718310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.730005 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1418/2861] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:04:14.733935 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:14.744893 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392135-a581-424c-8ec6-f0bd8ee73b3f admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:14.749799 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606428-4147-4039-99ee-728014f8702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.750479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606428-4147-4039-99ee-728014f8702a admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.750997 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606428-4147-4039-99ee-728014f8702a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.751291 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606428-4147-4039-99ee-728014f8702a admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.752026 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606428-4147-4039-99ee-728014f8702a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.753781 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606428-4147-4039-99ee-728014f8702a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.763958 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1444/2862] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:04:14.769309 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:14.778039 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394e79-752a-4745-834c-58b999a0e49c admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:14.782710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:14.783591 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.783876 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.784155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] PATH_INFO: `/v3/projects/6dec34901c464b468febc73ab2efa6fc/users/a601356e1eca4608b122b0d2720f150f/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.799267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dec34901c464b468febc73ab2efa6fc, user_id=a601356e1eca4608b122b0d2720f150f, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:14.801914 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:14.876830 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1419/2863] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:04:14 2022] PUT /identity/v3/projects/6dec34901c464b468febc73ab2efa6fc/users/a601356e1eca4608b122b0d2720f150f/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:14.888357 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:14.888651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:14.888930 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:14.917643 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] MFA Rules not processed for user `a601356e1eca4608b122b0d2720f150f`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:14.918884 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:14.985924 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1445/2864] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:15.017292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:15.019684 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:15.080677 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a1c4-7b28-4ac9-85aa-30bf01702550 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:15.086917 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9c1ba-8602-44e9-8311-09f1fbea81ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:15.087560 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c1ba-8602-44e9-8311-09f1fbea81ac service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:15.087832 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c1ba-8602-44e9-8311-09f1fbea81ac service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:15.088107 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c1ba-8602-44e9-8311-09f1fbea81ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:15.096618 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9c1ba-8602-44e9-8311-09f1fbea81ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:15.098022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9c1ba-8602-44e9-8311-09f1fbea81ac service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:15.107556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1420/2865] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:15.121373 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:15.184840 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f101d1-1a3c-47be-8993-5fa391c262ca None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:15.189505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:15.190394 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:15.190716 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:15.190992 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] PATH_INFO: `/v3/users/a601356e1eca4608b122b0d2720f150f` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:15.192199 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a601356e1eca4608b122b0d2720f150f)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:15.194188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:15.410273 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:15.416546 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a601356e1eca4608b122b0d2720f150f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:15.417211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a601356e1eca4608b122b0d2720f150f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:15.471355 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a601356e1eca4608b122b0d2720f150f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:15.479216 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a601356e1eca4608b122b0d2720f150f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:15.491012 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a601356e1eca4608b122b0d2720f150f'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:15.497205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1446/2866] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:04:15 2022] DELETE /identity/v3/users/a601356e1eca4608b122b0d2720f150f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:15.501703 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:15.502083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:15.502361 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:15.519665 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:15.520918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:15.534657 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:15.582533 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1421/2867] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:15.592379 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:15.593842 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:15.652492 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb054a9-e619-4fd2-84fd-912533226244 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:15.656187 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25f5e-1663-42e8-be45-02aa46baa048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:15.656835 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25f5e-1663-42e8-be45-02aa46baa048 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:15.657119 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25f5e-1663-42e8-be45-02aa46baa048 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:15.657398 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25f5e-1663-42e8-be45-02aa46baa048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:15.666475 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25f5e-1663-42e8-be45-02aa46baa048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:15.668003 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25f5e-1663-42e8-be45-02aa46baa048 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:15.677392 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1447/2868] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:16.073344 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.073826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:16.087691 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5a1f-c6fa-4ada-b561-fc7b909cdbfa None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.093664 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.094724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.095070 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.095427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] PATH_INFO: `/v3/projects/6dec34901c464b468febc73ab2efa6fc` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.096730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dec34901c464b468febc73ab2efa6fc)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.102132 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:16.241390 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dec34901c464b468febc73ab2efa6fc', 'request_id': 'req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:16.246786 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dec34901c464b468febc73ab2efa6fc', 'request_id': 'req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:16.333826 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dec34901c464b468febc73ab2efa6fc', 'request_id': 'req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:16.345035 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] The token cache is being invalidate because project 6dec34901c464b468febc73ab2efa6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:04:16.345322 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:16.345947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-686ba4e5-a463-40ce-ab38-de1f5d3d5d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:16.347504 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1422/2869] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:04:16 2022] DELETE /identity/v3/projects/6dec34901c464b468febc73ab2efa6fc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:16.352894 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.353192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.353471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.371465 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:16.372691 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:16.434198 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1448/2870] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:16.441625 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.441918 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.442197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.461718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:16.462970 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:16.470928 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1423/2871] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:16.475117 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.484954 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd5ca-235c-442f-81a0-abd9c714db96 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.489503 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.490147 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.490433 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.490750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.492031 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91905) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:04:16.492293 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.493897 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:16.505230 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1449/2872] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Jun 16 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:04:16.511935 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.521439 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647cbba-125c-4203-b747-712fe44d68d6 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.526187 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.526897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.527176 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.527449 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.528241 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.530126 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:16.642004 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1424/2873] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Jun 16 12:04:16 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:04:16.643028 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.652975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d29d9-9435-4694-9309-6ad25e1523ca admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.704647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:16.717631 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.718303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.718608 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.718902 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.719588 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.721511 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:16.820204 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1450/2874] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Jun 16 12:04:16 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:04:16.824182 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.834234 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa997-17af-4263-b619-18f9657022f3 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.838936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.846218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.846218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.846218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] PATH_INFO: `/v3/roles` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.846218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.846218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:16.853556 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1425/2875] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:04:16.857637 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.868665 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a260-4990-4731-a00b-e2d735fb23b9 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.880188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337be89-da25-4829-8ac8-9a22e9349ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.880188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337be89-da25-4829-8ac8-9a22e9349ada admin admin] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.880188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337be89-da25-4829-8ac8-9a22e9349ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.880188 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337be89-da25-4829-8ac8-9a22e9349ada admin admin] PATH_INFO: `/v3/roles` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.880597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337be89-da25-4829-8ac8-9a22e9349ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.880597 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337be89-da25-4829-8ac8-9a22e9349ada admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:16.887206 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1451/2876] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Jun 16 12:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:04:16.891384 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:16.901316 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cebae-21c2-4884-b104-f8e9db73d987 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:16.905982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:16.906890 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:16.908799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:16.908799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] PATH_INFO: `/v3/projects/916f03d03e21452eaf01d3e067bdca4e/users/9c6880d273554fd3915a9d75958183ad/roles/538368c9a6544ee3bb8b62b6e42254bb` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:16.923424 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916f03d03e21452eaf01d3e067bdca4e, user_id=9c6880d273554fd3915a9d75958183ad, role_id=538368c9a6544ee3bb8b62b6e42254bb)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:16.926283 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:17.021017 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1426/2877] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Jun 16 12:04:16 2022] PUT /identity/v3/projects/916f03d03e21452eaf01d3e067bdca4e/users/9c6880d273554fd3915a9d75958183ad/roles/538368c9a6544ee3bb8b62b6e42254bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:17.032008 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7039-4f23-494a-b5e5-5c85d22fcfa2 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:17.032300 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7039-4f23-494a-b5e5-5c85d22fcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:17.032580 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7039-4f23-494a-b5e5-5c85d22fcfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:17.059925 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-159d7039-4f23-494a-b5e5-5c85d22fcfa2 None None] MFA Rules not processed for user `9c6880d273554fd3915a9d75958183ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:17.061129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-159d7039-4f23-494a-b5e5-5c85d22fcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:17.124173 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1452/2878] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:17.135495 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:17.137256 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:17.180793 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:17.194271 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fbfb9-721f-4afa-ab55-4f7005a14f84 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:17.198016 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd8663dd0584d859bfb3268355f6a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:17.198688 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:17.198971 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:17.199247 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:17.207429 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:17.208841 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:17.218431 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1427/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:18.976477 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e199f0-4fcf-41b9-8bc3-2d986b271b9b None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:18.977192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e199f0-4fcf-41b9-8bc3-2d986b271b9b None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:18.977192 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e199f0-4fcf-41b9-8bc3-2d986b271b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:18.995891 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-94e199f0-4fcf-41b9-8bc3-2d986b271b9b None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:18.997111 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-94e199f0-4fcf-41b9-8bc3-2d986b271b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:19.079996 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1453/2880] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:19.080113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:19.080113 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:19.151387 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff63b-7c71-4a23-ac90-ffa16c5676f3 service cinder] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:19.156963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:19.157602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:19.157933 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:19.158208 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:19.166947 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:19.168510 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:19.178610 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1428/2881] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:23.367312 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae180-77a6-4500-8aea-44f89338cf53 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:23.367825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae180-77a6-4500-8aea-44f89338cf53 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:23.367934 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae180-77a6-4500-8aea-44f89338cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:23.386091 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-eefae180-77a6-4500-8aea-44f89338cf53 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:23.387332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-eefae180-77a6-4500-8aea-44f89338cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:23.395149 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1454/2882] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:23.411226 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:23.412631 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:23.426871 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09638b88-500d-4060-a74d-7a64ca64615d service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:23.432307 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:23.432936 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:23.433218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:23.433496 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:23.441614 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:23.443189 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:23.453148 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1429/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:26.832825 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799468c-a775-4a4e-b1fa-7f979d4b11c1 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:26.833471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799468c-a775-4a4e-b1fa-7f979d4b11c1 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:26.833471 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799468c-a775-4a4e-b1fa-7f979d4b11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:26.851250 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-e799468c-a775-4a4e-b1fa-7f979d4b11c1 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:26.852442 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-e799468c-a775-4a4e-b1fa-7f979d4b11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:26.860641 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1455/2884] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:26.891955 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:26.903174 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cc09f-45b9-4b0c-86f8-80c5569f0cb0 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:26.908805 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:26.909427 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:26.909711 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:26.909995 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:26.918411 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:26.920029 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:26.929724 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1430/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:29.737942 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:29.738456 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:29.738563 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:29.756552 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:29.760451 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:29.765889 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1456/2886] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:29.789103 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:29.795250 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871abd9-a5da-4a19-a0bf-7e5d4babb5eb service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:29.800723 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117b7c1-8849-4ec0-88af-6c8b0cf1231d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:29.801433 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b7c1-8849-4ec0-88af-6c8b0cf1231d service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:29.801717 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b7c1-8849-4ec0-88af-6c8b0cf1231d service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:29.801991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b7c1-8849-4ec0-88af-6c8b0cf1231d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:29.810412 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b7c1-8849-4ec0-88af-6c8b0cf1231d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:29.812043 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b7c1-8849-4ec0-88af-6c8b0cf1231d service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:29.821315 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1431/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:31.817549 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:31.827072 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4a5e-e6c4-4dd7-844d-480c9c9488a9 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:31.831550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:31.832410 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:31.832692 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:31.832971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] PATH_INFO: `/v3/users/9c6880d273554fd3915a9d75958183ad` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:31.834154 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6880d273554fd3915a9d75958183ad)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:31.836129 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:32.013744 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:32.026231 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6880d273554fd3915a9d75958183ad'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.026907 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6880d273554fd3915a9d75958183ad'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.127253 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6880d273554fd3915a9d75958183ad'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.134340 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6880d273554fd3915a9d75958183ad'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.146808 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6880d273554fd3915a9d75958183ad'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.153046 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1457/2888] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:04:31 2022] DELETE /identity/v3/users/9c6880d273554fd3915a9d75958183ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:32.158015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:32.158516 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:32.158643 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:32.177566 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:32.179210 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:32.237937 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1432/2889] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:32.247540 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:32.249002 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:32.305871 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac370fb5-b522-4fbd-87e6-f8005f4c521a admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:32.309427 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6859efb-9bf3-4039-b462-288ce89526f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:32.310062 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859efb-9bf3-4039-b462-288ce89526f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:32.310352 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859efb-9bf3-4039-b462-288ce89526f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:32.310657 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859efb-9bf3-4039-b462-288ce89526f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:32.319769 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6859efb-9bf3-4039-b462-288ce89526f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:32.321211 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6859efb-9bf3-4039-b462-288ce89526f7 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:32.331240 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1458/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:32.761982 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:32.763451 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:32.776207 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44a7f8-718e-4142-a0ba-c5487f6b10c9 None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:32.780953 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:32.781829 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:32.782179 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:32.782462 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] PATH_INFO: `/v3/projects/916f03d03e21452eaf01d3e067bdca4e` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:32.784026 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916f03d03e21452eaf01d3e067bdca4e)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:32.785943 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:32.813499 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:32.899571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916f03d03e21452eaf01d3e067bdca4e', 'request_id': 'req-45a2c20c-8771-4fa5-9eec-a1495471a578'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.905062 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916f03d03e21452eaf01d3e067bdca4e', 'request_id': 'req-45a2c20c-8771-4fa5-9eec-a1495471a578'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:32.990198 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916f03d03e21452eaf01d3e067bdca4e', 'request_id': 'req-45a2c20c-8771-4fa5-9eec-a1495471a578'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:33.002518 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] The token cache is being invalidate because project 916f03d03e21452eaf01d3e067bdca4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:04:33.002839 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:33.003563 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:04:33.004864 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54bca4-aafa-4b19-a55e-ac36e392a529 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:33.005323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1433/2891] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:04:32 2022] DELETE /identity/v3/projects/916f03d03e21452eaf01d3e067bdca4e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:04:33.005424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54bca4-aafa-4b19-a55e-ac36e392a529 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:33.005424 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54bca4-aafa-4b19-a55e-ac36e392a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:33.024105 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-7e54bca4-aafa-4b19-a55e-ac36e392a529 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:33.029103 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-7e54bca4-aafa-4b19-a55e-ac36e392a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:33.091560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1459/2892] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:33.109584 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:33.111040 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:33.190204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c20c-8771-4fa5-9eec-a1495471a578 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:33.196306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:33.196975 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:33.197257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:33.197532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:33.206689 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:33.208310 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:33.218897 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1434/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:36.178615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:36.179210 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:36.179310 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:36.197975 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:36.199201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:36.207317 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1460/2894] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:36.230332 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:36.231986 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:36.247033 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b24c1-46b4-42dc-b1bc-aeb5708fa63c service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:36.253069 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f6db-0245-4d57-ba28-b81384ecf6ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:36.253705 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f6db-0245-4d57-ba28-b81384ecf6ba service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:36.253991 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f6db-0245-4d57-ba28-b81384ecf6ba service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:36.254269 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f6db-0245-4d57-ba28-b81384ecf6ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:36.262492 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1f6db-0245-4d57-ba28-b81384ecf6ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:36.264086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1f6db-0245-4d57-ba28-b81384ecf6ba service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:36.273486 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1435/2895] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:46.192611 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:46.270710 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=55,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:04:47.294362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:04:47.295468 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:47.364730 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8d9b3-3e51-492e-9e68-589da61b8bff None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:04:47.369647 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:04:47.370279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:47.370560 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:47.370865 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:47.372589 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:47.384429 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:04:47.386223 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82376-2634-455b-999d-1d65e58def4b service placement] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:04:47.396324 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1461/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:04:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:04:53.414949 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] REQUEST_METHOD: `POST` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:04:53.415481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:04:53.415481 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:04:53.431880 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.auth.core [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] MFA Rules not processed for user `1ffce04f12dc4d3e8c9f5bf0990ab4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91906) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:04:53.433063 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:04:53.485904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1436/2897] 10.222.0.36 () {58 vars in 957 bytes} [Thu Jun 16 12:04:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:04:57.391920 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=32 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:03.479544 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=25 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:08.526860 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5992-53b0-4fa1-84bb-c9fb4d289aa8 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:08.527402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5992-53b0-4fa1-84bb-c9fb4d289aa8 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:08.527402 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5992-53b0-4fa1-84bb-c9fb4d289aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:08.545097 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-414d5992-53b0-4fa1-84bb-c9fb4d289aa8 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:05:08.546292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-414d5992-53b0-4fa1-84bb-c9fb4d289aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:05:08.554837 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1462/2898] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:05:08.573230 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:08.586083 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9434ff-694f-45bd-b179-3e0a9b7679ea None None] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:08.591590 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:08.592257 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:08.592541 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:08.592822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:08.601445 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:08.605404 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:08.612774 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1437/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:05:11.913092 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd202ea6-4b04-46eb-bf2b-863ec7a8bf28 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:11.913655 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd202ea6-4b04-46eb-bf2b-863ec7a8bf28 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:11.913764 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd202ea6-4b04-46eb-bf2b-863ec7a8bf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:11.931292 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-dd202ea6-4b04-46eb-bf2b-863ec7a8bf28 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:05:11.932780 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-dd202ea6-4b04-46eb-bf2b-863ec7a8bf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:05:11.940551 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1463/2900] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:05:11.958571 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:11.969716 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f5284-9a53-4be8-ad32-891d3308e408 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:11.975743 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:11.976367 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:11.976646 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:11.976919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:11.985197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:11.986782 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:11.996022 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1438/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:05:14.823236 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fec5-aaaa-40e3-bc99-fd3091098882 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:14.823743 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fec5-aaaa-40e3-bc99-fd3091098882 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:14.823868 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fec5-aaaa-40e3-bc99-fd3091098882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:14.841824 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-2977fec5-aaaa-40e3-bc99-fd3091098882 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:05:14.843075 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-2977fec5-aaaa-40e3-bc99-fd3091098882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:05:14.851710 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1464/2902] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:05:14.877410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:14.889172 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864243e-ad21-4908-b45c-7af6590174a4 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:14.894726 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:14.896128 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:14.896501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:14.896963 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:14.905883 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:14.907771 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:14.918231 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1439/2903] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:05:20.085559 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640af6b-c45e-4286-910c-ac7899cc18cb None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:20.086056 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640af6b-c45e-4286-910c-ac7899cc18cb None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:20.086163 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640af6b-c45e-4286-910c-ac7899cc18cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:20.104304 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-3640af6b-c45e-4286-910c-ac7899cc18cb None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:05:20.111007 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-3640af6b-c45e-4286-910c-ac7899cc18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:05:20.116362 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1465/2904] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:05:20.133817 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:20.145122 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11a30-3822-47dc-8570-b643e3af6651 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:20.150988 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:20.151621 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:20.151904 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:20.152178 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:20.160365 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:20.161978 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:20.171416 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1440/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:05:23.321731 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] REQUEST_METHOD: `POST` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:23.322218 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:23.322345 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:23.340413 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.auth.core [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] MFA Rules not processed for user `7a61f538ea9c41cc98218141be79ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91905) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:05:23.341595 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:05:23.349684 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1466/2906] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 16 12:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:05:23.377197 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:23.388825 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4bfda-79e9-41d3-a9e1-dbc9a783f73f service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:23.394204 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad599a6997f44dbb42472277cba7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:23.394858 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:23.395139 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:23.395410 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:23.404180 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:23.405733 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:23.414926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1441/2907] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:05:33.334756 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=15 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:33.410838 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=30 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:05:55.921713 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:55.923338 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:05:55.935838 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd96ff-a4f5-449a-a185-71d381b8f704 None None] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:55.940372 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:55.941224 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:55.941505 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:55.941782 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] PATH_INFO: `/v3/users/1ffce04f12dc4d3e8c9f5bf0990ab4ef` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:55.942989 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffce04f12dc4d3e8c9f5bf0990ab4ef)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:55.944895 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:56.122755 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffce04f12dc4d3e8c9f5bf0990ab4ef'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.123339 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffce04f12dc4d3e8c9f5bf0990ab4ef'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.199849 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffce04f12dc4d3e8c9f5bf0990ab4ef'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.207017 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffce04f12dc4d3e8c9f5bf0990ab4ef'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.218915 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffce04f12dc4d3e8c9f5bf0990ab4ef'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.225479 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1467/2908] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:05:55 2022] DELETE /identity/v3/users/1ffce04f12dc4d3e8c9f5bf0990ab4ef => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:05:56.436263 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:05:56.448391 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572df0-3c13-4798-ac23-5eeb73085876 service nova] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:05:56.507154 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:05:56.508011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:05:56.508292 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:05:56.508564 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] PATH_INFO: `/v3/projects/51410a1748f44d24ae66abf772e16b5d` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:05:56.509734 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51410a1748f44d24ae66abf772e16b5d)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:05:56.511714 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:05:56.612369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51410a1748f44d24ae66abf772e16b5d', 'request_id': 'req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.617756 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51410a1748f44d24ae66abf772e16b5d', 'request_id': 'req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.674100 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51410a1748f44d24ae66abf772e16b5d', 'request_id': 'req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.687251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] The token cache is being invalidate because project 51410a1748f44d24ae66abf772e16b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91906) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:05:56.687251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.687251 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:05:56.687852 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1442/2909] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:05:56 2022] DELETE /identity/v3/projects/51410a1748f44d24ae66abf772e16b5d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:06:06.221946 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:06.682341 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:51.867315 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:06:51.868750 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:51.931948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd05df-d20a-483d-862b-503f9e44a428 admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:06:51.992201 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:06:51.993303 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:06:51.993736 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:06:51.994015 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:06:51.995948 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:52.069016 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:06:52.070615 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:06:52.082294 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1468/2910] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:06:53.256532 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:06:53.257934 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:53.270369 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118e32-66d7-4b8a-8a5e-cecc8e838fd8 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:06:53.274169 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:06:53.274919 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:06:53.275272 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:06:53.275617 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:06:53.277501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:53.291863 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:06:53.293348 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:06:53.304730 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1443/2911] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:06:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:06:55.892193 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:06:55.893701 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:55.904388 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125e8ee-4a06-4ba8-98fb-80d538a3fb28 service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:06:55.907998 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a7608c1ceb64497b74bd532e051aee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:06:55.908630 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:06:55.908914 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:06:55.909190 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:06:55.910928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:55.962142 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=100 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:06:55.973412 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:06:55.974885 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:06:55.985185 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1469/2912] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:06:59.530306 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:06:59.531879 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:59.611086 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47035cdc-cb4f-4cc6-b9cb-824e21d60b10 service neutron] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:06:59.616092 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:06:59.616736 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:06:59.617024 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:06:59.617303 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:06:59.619125 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:06:59.631082 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:06:59.632742 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:06:59.650010 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1444/2913] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:07:03.079977 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:07:03.091969 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17f73-46ad-4de1-a15b-1a821be709ae service neutron] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:07:03.096991 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:07:03.097651 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] REQUEST_METHOD: `GET` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:07:03.097939 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:07:03.098226 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:07:03.100043 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:07:03.112834 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:07:03.114416 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:07:03.124779 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1470/2914] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:07:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:07:03.228799 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:07:03.231124 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:07:03.244916 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3654ec-e08f-44ca-9819-d0eeb7311c73 service placement] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:07:03.250049 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:07:03.250945 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:07:03.251227 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:07:03.251501 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] PATH_INFO: `/v3/users/c179da3d724749c9988092fde5195534` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:07:03.252676 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c179da3d724749c9988092fde5195534)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:07:03.254575 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:07:03.442534 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c179da3d724749c9988092fde5195534'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.443216 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c179da3d724749c9988092fde5195534'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.450011 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c179da3d724749c9988092fde5195534'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.507885 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c179da3d724749c9988092fde5195534'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.520218 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c179da3d724749c9988092fde5195534'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.526089 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1445/2915] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:07:03 2022] DELETE /identity/v3/users/c179da3d724749c9988092fde5195534 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:07:03.743586 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:07:03.756545 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9dd6-e608-410e-b844-fabeb98e9c63 service placement] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:07:03.813622 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:07:03.814485 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:07:03.814804 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:07:03.815085 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] PATH_INFO: `/v3/projects/ff126b753aee481bae3ecc8bb79cea34` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:07:03.816269 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff126b753aee481bae3ecc8bb79cea34)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:07:03.818196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:07:03.914461 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff126b753aee481bae3ecc8bb79cea34', 'request_id': 'req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.920688 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff126b753aee481bae3ecc8bb79cea34', 'request_id': 'req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.965509 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff126b753aee481bae3ecc8bb79cea34', 'request_id': 'req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.976675 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] The token cache is being invalidate because project ff126b753aee481bae3ecc8bb79cea34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:07:03.976971 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.977607 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:03.979180 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1471/2916] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:07:03 2022] DELETE /identity/v3/projects/ff126b753aee481bae3ecc8bb79cea34 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:07:03.984015 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:07:03.985417 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:07:03.998484 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4d5f6-7ee3-49de-95a8-d9f0cccb6678 admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:07:04.042810 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:04.053718 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:07:04.054613 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:07:04.054886 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:07:04.055155 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] PATH_INFO: `/v3/users/0306a836dcda40be8b0ffef02ab14992` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:07:04.056358 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0306a836dcda40be8b0ffef02ab14992)` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:07:04.058267 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:07:04.229508 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0306a836dcda40be8b0ffef02ab14992'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.230290 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0306a836dcda40be8b0ffef02ab14992'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.237377 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0306a836dcda40be8b0ffef02ab14992'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.279926 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0306a836dcda40be8b0ffef02ab14992'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.292277 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.notifications [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0306a836dcda40be8b0ffef02ab14992'} {{(pid=91906) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.298323 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1446/2917] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Jun 16 12:07:03 2022] DELETE /identity/v3/users/0306a836dcda40be8b0ffef02ab14992 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:07:04.538288 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Authenticating user token {{(pid=91905) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:07:04.540196 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.fernet_utils [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91905) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:07:04.555613 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131a5ce-58f1-4da0-af92-64ed5dbb5acb admin admin] Validating token access rules against request {{(pid=91905) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:07:04.613748 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a61f538ea9c41cc98218141be79ba7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76796d2f47b24128882c958275f16408', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91905) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:07:04.614640 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:07:04.614928 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:07:04.615205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] PATH_INFO: `/v3/projects/3df460cfac4c4e148685a78ecd6572d9` {{(pid=91905) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:07:04.616386 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df460cfac4c4e148685a78ecd6572d9)` {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:07:04.618279 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] RBAC: Authorization granted {{(pid=91905) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:07:04.628332 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:04.708205 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df460cfac4c4e148685a78ecd6572d9', 'request_id': 'req-90b5cf52-71cf-4202-a569-49f48a5121c3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.713512 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df460cfac4c4e148685a78ecd6572d9', 'request_id': 'req-90b5cf52-71cf-4202-a569-49f48a5121c3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.793455 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df460cfac4c4e148685a78ecd6572d9', 'request_id': 'req-90b5cf52-71cf-4202-a569-49f48a5121c3'} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.806528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] The token cache is being invalidate because project 3df460cfac4c4e148685a78ecd6572d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91905) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:07:04.806528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.806528 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG keystone.notifications [None req-90b5cf52-71cf-4202-a569-49f48a5121c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91905) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:07:04.807166 dv-cinder-846146-2-smb devstack@keystone.service[91905]: [pid: 91905|app: 0|req: 1472/2918] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Jun 16 12:07:04 2022] DELETE /identity/v3/projects/3df460cfac4c4e148685a78ecd6572d9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:07:14.294737 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:07:14.801550 dv-cinder-846146-2-smb devstack@keystone.service[91905]: DEBUG dbcounter [-] [91905] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:10:18.021191 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Authenticating user token {{(pid=91906) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:10:18.022644 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:10:18.157030 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7e77-72a7-40c6-9be0-11c1b0a0264b admin admin] Validating token access rules against request {{(pid=91906) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:10:18.216423 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efad13e88b4d58be51b897827532f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f980675b94054871bcae0aaeaf9bd290', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91906) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:10:18.217077 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] REQUEST_METHOD: `GET` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:10:18.217364 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] SCRIPT_NAME: `/identity` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:10:18.217666 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91906) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:10:18.219479 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.fernet_utils [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91906) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:10:18.230944 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:10:18.232535 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a606178-03ff-4d0d-b88a-ec5bc09d8e79 service placement] RBAC: Authorization granted {{(pid=91906) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:10:18.242822 dv-cinder-846146-2-smb devstack@keystone.service[91906]: [pid: 91906|app: 0|req: 1447/2919] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jun 16 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:10:28.238602 dv-cinder-846146-2-smb devstack@keystone.service[91906]: DEBUG dbcounter [-] [91906] Writing DB stats keystone:SELECT=89 {{(pid=91906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}